# robots.txt for search engines User-agent: Googlebot Crawl-delay: 10 User-agent:* Disallow: /cgi-bin/ User-agent:* Disallow: /productdetails.asp