Comments on: Must Read: Google Robots.txt Parsing Weirdness News and views from a Software Architect and Web Entrepreneur on Java, PHP and Web 2.0 Technologies. 2009-10-10T02:28:13Z WordPress http://blog.taragana.com/index.php/archive/must-read-google-robotstxt-parsing-weirdness/feed/atom/ By: Palapple Palapple http://www.palapple.com http://blog.taragana.com/?p=2663#comment-481499 2008-07-22T08:54:49Z 2008-07-22T08:54:49Z One more reference from Google Webmasters Tools

http://www.google.com/support/webmasters/bin/answer.py?answer=40360&query=robot&topic=&type=

]]> By: sharfah sharfah http://fahdshariff.blogspot.com http://blog.taragana.com/?p=2663#comment-481411 2008-07-07T17:44:52Z 2008-07-07T17:44:52Z For anyone interested, here is the user guide for robots.txt:

http://www.robotstxt.org/robotstxt.html

]]>