Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I’m scraping a site with HttpWebRequest, but the site is returning an error. The page works fine when I hit it from my browser. I’d like to compare them to see what may be causing the error. I know how to intercept the request from my browser to inspect the headers, but how do I view the data sent by HttpWebRequest?
In order to compare what you do in code, and what the browser does, I am sure a HTTP debugging tool such as Fiddler, would be the easiest solution.
Fiddler acts as a proxy between client and server, and displays all information sent over the HTTP protocol.
It is possible that you will need to configure your .NET app to use the proxy that Fiddler provides. This blog post provides details on the subject.