User-agent: * Disallow: /cgi-bin/ Disallow: *.log Disallow: *.cfg Disallow: *.bat Disallow: *.exe Disallow: *.htp