# don't let search engines see the RSS feed, it's just confusing. User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic # User-agent: libwww-perl # User-agent: Teleport Pro Disallow: /searchtools-rss.xml User-agent: * Disallow: /cgi-bin/ Disallow: /chat/ Disallow: /database/admin Disallow: /debtest/ Disallow: /database/search/error_log Disallow: /database/dam/error_log Disallow: /database/dam/_vti_cnf/error_log Disallow: /database/sire/error_log Disallow: /database/sire/_vti_cnf/error_log Disallow: /database/litters/error_log Disallow: /database/litters/_vti_cnf/error_log Disallow: /database/fanciers/error_log Disallow: /database/fanciers/_vti_cnf/error_log Disallow: /msc/error_log Disallow: /msc/_vti_cnf/error_log