Home/ Questions/Q 5988789
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-22T23:00:31+00:00

I’m using the Html Agility Pack and I keep getting this error. The remote

  • 0

I’m using the Html Agility Pack and I keep getting this error. “The remote server returned an error: (500) Internal Server Error.” on certain pages.

Now I’m not sure what this is, as I can use Firefox to get to these pages without any problems.

I have a feeling the website itself is blocking and not sending a response. Is there a way I can make my HTML agility pack call more like a call that is being called from FireFox?

I’ve already set a timer in there so it only sends to the website every 20 seconds.

Is there any other method I can use?

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Set a User-Agent similar to a regular browser. A User agent is a http header being passed by the http client(browser) to identify itself to the server.

    • 0