#Block All User-agent: * Disallow: /_scripts/ Disallow: /_scriptsGlobal/ Disallow: /webart/ Disallow: /redir/ #Special Rule for Froogle/Google User-agent: Googlebot Allow: /webart/Products/ #http://www.become.com/site_owners.html User-agent: BecomeBot Crawl-Delay: 30