Home/ Questions/Q 7068013
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-28T05:16:19+00:00

I have a web app that allows you to paste a large number of

  • 0

I have a web app that allows you to paste a large number of urls in (anywhere from 2000 – 15000), it then visits each page to download the source and do some processing.

I’ve tried a couple methods, currently it uses ajax to send each url one at a time to a WebMethod which then uses ThreadPool.QueueUserWorkItem to push the request onto a queue and do the processing when it can so that many threads are running at the same time. This seems to cause problem (the Visual Studio web server dies occasionally which can’t be good).

Just wondering if anyones done anything similar, knows a better way. I guess being able to throttle the number of concurrent threads somehow would help.

Thanks

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Don’t use the built in webserver. Use IIS proper

    • 0