Comments on: How To Use Robots.Txt File? http://www.webresourcesdepot.com/how-to-use-robotstxt-file/ Free Web Resources Sat, 21 Nov 2009 05:25:32 -0600 http://wordpress.org/?v=2.8.5 hourly 1 By: Franksite1 http://www.webresourcesdepot.com/how-to-use-robotstxt-file/comment-page-1/#comment-65774 Franksite1 Sat, 01 Aug 2009 20:42:03 +0000 http://www.webresourcesdepot.com/how-to-use-robotstxt-file/#comment-65774 Hey thanks for this information. It has really helped me out in figuring out the first steps in removing my old website. Thanks again! :) Hey thanks for this information. It has really helped me out in figuring out the first steps in removing my old website. Thanks again! :)

]]> By: creativebrain http://www.webresourcesdepot.com/how-to-use-robotstxt-file/comment-page-1/#comment-54495 creativebrain Mon, 08 Jun 2009 14:26:49 +0000 http://www.webresourcesdepot.com/how-to-use-robotstxt-file/#comment-54495 hehe, I only know disallow and allow parameter.. but there are other parameters.. thanks for your post :D btw, how to use Request-rate, Crawl-delay, Visit-time, and Sitemap parameter? can u give me some example? hehe, I only know disallow and allow parameter.. but there are other parameters.. thanks for your post :D

btw, how to use Request-rate, Crawl-delay, Visit-time, and Sitemap parameter? can u give me some example?

]]>