Question

We have an application which has about 15000 pages. For better SEO reasons we had to change the URL’s. Google had already crawled all of these pages earlier and due to the change, we see a lot of duplicate titles/meta description on webmasters. Our impressions on google have dropped and we believe this is the reason. Correct me if my assumption is incorrect. Now we are not able to write a regular expression for the change of URL’s using a 301 redirect, because the change was such. The only way to do it would be to write 301 redirects for individual URL’s which is not feasible for 10000 URL’s. Now can we use a robots meta tag with NOINDEX? My question basically is if I write a NOINDEX metatag will google remove the already indexed URL’s? If not what are the other ways to remove the old indexed URL’s from google? ANother thing which I can do is make all the previous pages 404 errors to avoid the duplicates, but will that be a right thing to do?

Answer 1

Now we are not able to write a regular expression for the change of
URL’s using a 301 redirect, because the change was such. The only way
to do it would be to write 301 redirects for individual URL’s which is
not feasible for 10000 URL’s.

Of course you can! I’m rewriting more than 15000 URLs with mod_rewrite and RewriteMap!
This is just a matter of scripting / echo all URLs and mastering vim, but you can, and easily. If you need more information, just ask.

What you can do is a RewriteMap fils like this:

/baskinrobbins/branch/branch1/ /baskinrobbins/branch/Florida/Jacksonville/branch1

I’ve made a huge answer here and you can very easily adapt it to your needs.

I could do that job in 1-2 hours max but I’m expensive ;).