User-agent: Googlebot Disallow: /*.bak$ Disallow: /*.cgi$ Disallow: /*.exe$ Disallow: /*.gif$ Disallow: /*.ico$ Disallow: /*.inc$ Disallow: /*.jpg$ Disallow: /*.lock$ Disallow: /*.log$ Disallow: /*.pl$ Disallow: /*.png$ Disallow: /*.vcf$ Disallow: /*.wav$ Disallow: /generator Disallow: /images Disallow: /.htaccess User-agent: * Disallow: /~.bak Disallow: /~.cgi Disallow: /~.exe Disallow: /~.gif Disallow: /~.ico Disallow: /~.inc Disallow: /~.jpg Disallow: /~.lock Disallow: /~.log Disallow: /~.pl Disallow: /~.png Disallow: /~.vcf Disallow: /~.wav Disallow: /generator/ Disallow: /images/ Disallow: /.htaccess Sitemap: http://www.thedoccenter.com/sitemap.xml Sitemap: http://www.thedoccenter.com/sitemap.xml.gz Sitemap: http://www.thedoccenter.com/urllist.txt Sitemap: http://www.thedoccenter.com/urllist.txt.gz Sitemap: http://www.thedoccenter.com/ror.xml Sitemap: http://www.thedoccenter.com/ror.xml.gz # Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name "*" is for everyone # Disallow: if this matches first part of requested path, forget it # Tells Scanning Robots Where They Are And Are Not Welcome # # Worldwide TeleNet # Robot Exclusion File -- robots.txt # Author: Worldwide TeleNet # Last Updated: 6/16/09