User-agent: * # This * symbol tells all Spiders to follow the below rules Disallow: /cgi-bin/ # Again this helps clean up my search results so that I don't get half pages and 404 errors Disallow: /acatalog/*.cat Disallow: /acatalog/*.fil Disallow: /acatalog/test/ Disallow: /acatalog/bounce* Disallow: *cPath=* Disallow: *product_info.php*