Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
How would I disallow all dynamic pages within my robots.txt?
E.g.
page.php?hello=therepage.php?hello=everyonepage.php?thank=youI would like page.php AND all possible dynamic versions to be disallowed.
At the moment I have
User-Agent: *
Disallow: /page.php
But this still allows e.g. page.php?hello=there
What you’ve already got should block all access to /page.php for all search engines which respect robots.txt (no matter whether there are any query string parameters provided)
Don’t forget robots.txt is only for robots 🙂 If you’re trying to block users from accessing the page you’ll need to use .htaccess or similar