User-Agent: * Crawl-delay: 30 Disallow: /cgi-bin/ Disallow: /extanet/ Disallow: /public_downloads/ Disallow: /uploads/ Disallow: /XML_generator/ Disallow: /wip/