# robot.txt muss im stammverzeichnis liegen!!! User-agent: * Disallow: User-agent: * Disallow: /cgi-local/ User-agent: * Disallow: /img/ # Ladefuzzies raus User-agent: Teleport* Disallow: / User-agent: Webwhacker* Disallow: / User-agent: WebDevil* Disallow: / User-agent: Webzip* Disallow: / User-agent: Net Attache* Disallow: / User-agent: SiteSnagger* Disallow: / User-agent: Googlebot Disallow: /*.gif$ #Keep Rover from grabbing Email addresses from our site User-agent: WX_mail/2.000* Disallow: / User-agent: EmailCollector* Disallow: / User-agent: WhoWhere* Disallow: / User-Agent: Roverbot* Disallow: / User-Agent: ActiveAgent* Disallow: / User-agent: EmailSiphon* Disallow: /