# robots.txt for http://www.web-caching.com/ User-agent: ExtractorPro Disallow: / User-agent: DIIbot Disallow: / User-agent: * Disallow: /cgi-bin