User-agent: * Disallow: /cgi-bin/ Disallow: /doc Disallow: /images Disallow: /temp* Disallow: /*.log Disallow: /*.htd Disallow: /*.htn Disallow: /*.hts Disallow: /*idx.php