I’m having some minor issues with a web site I’m working on, and I’d like to put up a test version where I make some tweaks to see how things look (I’d like to test on mobile devices as well, so having a live version will certainly be the easiest way to test on multiple devices).
Ideally I’d like to have something like mysite.com/test/ which will start off with an exact copy of the main site. However, I don’t want to incur any problems with google etc due to ‘duplicate content’.
What would be the best way to avoid such problems?
I imagine you’ll want a robots.txt file in the root of your domain to instruct the crawler as to which pages it can scan.
http://tools.seobook.com/robots-txt/