Question

We are designing a Stress Test Application which will send mass HTTP requests of size “1 MB” to a particular Web Service. To achieve stress, we are using multiple threads in the application. Structure is something like we have X EnqueueThreads which will create the HTTPRequest data and they will add it them to the queue. And the Y WorkerThreads will dequeue the requests and they will submit to web service.
All requests are aysnchronous.
Now the problem here is, Enqueue threads are working much faster than WorkerThreads so if there is no stop/wait condition, they will add the requests until the out of memory exception is thrown and thus making the injector (where this utility will be running) slow.
At present we are handling the OutOfMemory exceptions and making the enqueuethreads sleep for some time. Another way I could think of is limit the queue size.

However I would like to know the views on what should be the best approach to use the limited system resources (specially memory).?
Thanks in advance.

Answer 1

Well, according to the topic of the question, best way to avoid out of memory exception would be not to create objects that fill in that memory.

Handling exception is easiest solution, though may bring different difficulties and inconsistencies into the application with time. Another way would be getting available size of memory resources like this:

Process currentProcess = Process.GetCurrentProcess();
long memorySize = currentProcess.PrivateMemorySize64

Then you can calculate the length of your queue based on estimate of one object memory capacity.

Another way would be to check for memory size in each worker thread. Whenever there’s no memory, the thread can just finish. This way many threads would be spawning and dying but the application would be at maximum available capacity.