# robots.txt file for http://www.blahblahblah.com # directed to all spiders, not just Scooter User-agent: * Disallow: / Disallow: /cgi-bin/ Disallow: /stats/ Disallow: /weblogs/ Disallow: /autoresponder/