# temporarily disallow ALL indexing... # User-agent: * # Disallow: / # Directory disallows... User-agent: * Disallow: /cgibin/ Disallow: /traffic/ Disallow: /editors/ Disallow: /hterror/ Disallow: /hterrors/ Disallow: /meta/ Disallow: /results/ Disallow: /gifs/ Disallow: /css/ # Slow down abusive Yahoo Slurp... User-agent: Slurp Crawl-delay: 360 # http://info.webcrawler.com/mak/projects/robots/exclusion-admin.html