# robots.txt for http://www.gotspirit.com/ User-agent: * Disallow: /CExplorer/ Crawl-Delay: 5