# robots.txt for http://www.starcreator.com/ # based on the robots.txt for whitehouse.gov # (no, I won't block any information about Iraq.) User-agent: * Disallow: /cgi-bin/ # Google in particular has been completely ignoring # my directives. I'm half-ready to complain very # vocally about it. User-agent: Googlebot Disallow: /cgi-bin/ # archive.org can archive whatever it wants. User-agent: ia_archiver Disallow: