Thread: What is Robots.txt
View Single Post
  #3 (permalink)  
Old 14-04-2008, 03:26 AM
limcs's Avatar
limcs limcs is offline
Administrator
  
Join Date: Jul 2006
Location: Penang
Posts: 1,757
Rep Power: 10
limcs has a spectacular aura about limcs has a spectacular aura about limcs has a spectacular aura about
Pretty much that's it.

It can be used to block certain search engine bots, as well as block their access to certain pages.
__________________
Read the Rules
Reply With Quote