24-09-2007, 05:59 PM
|
|
Novice Webmaster
|
|
Join Date: Apr 2004
Location: Miri, Sarawak
Posts: 93
Rep Power: 58
|
|
Can I prevent Search Engine from crawling into my subdomain?
I plan to create a subdomain where I have the exact copy of my live and working site, because I plan to play with Wordpress 2.3 before doing upgrade to my live site, and probably will start playing with Wordpress SVN. Now, if I do an exact copy of content, that means that the search engine will start penalizing my site. So, what can I do to prevent any bots, crawlers or spider from crawling to this copy of my site?
Thanks in advance. I do plan to play around in a local environment, but I would prefer to test it in a Linux environment e.g. my webhost.
|