Home/ Questions/Q 7987421
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-04T12:08:40+00:00

In the last days the bingbot is trying to access pages that don’t exist

  • 0

In the last days the bingbot is trying to access pages that don’t exist and I didn’t get up to now to identify the origin of these links. Before the original and valid url it is increasing a random dir, example: 

GET /ToWLQ/my-valid-url-here-4416.html HTTP/1.1" 404 2608 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"

My correct url is:
/my-valid-url-here-4416.html

The string /XuRT/ and the pages are frequently changed.

I would like to redirect through the htaccess to avoid so many mistakes. 

from: /ToWLQ/my-valid-url-here-4416.html  
to: /my-valid-url-here-4416.html

Thank you

Vera

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    The best answer here depends on whether you can effectively generalize the pattern that the bingbot prefixes your pages with, as well as the pattern of your pages. Based on the information you provide in the question, a rule like this in your .htaccess will work:

    RewriteRule ^[A-Z][a-z][A-Z]+/(.*) $1 [L,R=301,QSA]

    This assumes that the first letter will be uppercase, the second lowercase, and the rest uppercase, followed by a slash then your real page.

    EDIT: New rewrite rule based on more information:

    RewriteCond %{HTTP_USER_AGENT}  (msnbot|bingbot)
RewriteRule ^([a-zA-Z]{5}/)+(.*) $2 [L,R=301,QSA]
    • 0