User-agent: * Disallow: /Test/ Disallow: /images/ Disallow: /img/ Disallow: /css/ Disallow: /cgi-bin/ Disallow: /rw_common/ Disallow: /files/ Sitemap: http://www.oahas.org/sitemap.xml User-agent: Googlebot # disallow all files ending with these extensions Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.txt$