User-agent: * sitemap: sitemap.xml Disallow: /cgi-bin/ Disallow: /img/ Disallow: /log/ Disallow: /dat/ Disallow: /data/ Disallow: /*.gif$