I am using asp.net 2010, and I would like to know how can I go about completely hiding a particular page from search engines, similar to how Facebook’s security settings are set (for example, if I search for my real name, my fb page will now show up in google).
Share
Use robots.txt
For extra safety, you can analyze user agent string, and if it belongs to a crawler, return an empty page.