Thread: What is robots.txt file
View Single Post
  #6 (permalink)  
Old 07-03-2008, 09:32 PM
iamfreelancer's Avatar
iamfreelancer iamfreelancer is offline
Vibrate your Brain Please
  
Join Date: Sep 2005
Location: in my body lar...
Posts: 1,217
Rep Power: 62
iamfreelancer will become famous soon enough iamfreelancer will become famous soon enough
refer to the below for full details of robots.txt

Robots Exclusion Standard - Wikipedia, the free encyclopedia
The Web Robots Pages
Reply With Quote