08-04-2008, 01:24 AM
|
|
Novice Webmaster
|
|
Join Date: Apr 2008
Location: HostGab.com
Posts: 19
Rep Power: 0
|
|
The robots.txt file is a good way to prevent this page from getting indexed. However, not every site can use it. The only robots.txt file that the spiders will read is the one at the top html directory of your server. This means you can only use it if you run your own domain.
|