I am trying to scrape a webpage when it throws a “potentially dangerous script” error. Everytime I do this, I get a server 500 but I can scrape a normal, operating page. Is there a way I can scrape a webpage when it throws an error?
Thanks
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
Why not use ASP.NET health monitoring? There’s a mail provider that will automatically send the error details to you without any manual scraping and you can configure it all with just some config file entries. Easy!