Question

I am required to have multiple threads writing to a single buffer (contiguous chunk of memory). The brute force method will be as follow

1. The thread that wants to write to buffer will acquire lock on the buffer
2. Entire buffer is locked and therefore only the thread that acquired lock can modify the buffer.
3. The thread write to buffer.
4. The thread unlocks the buffer.

This method serializes all threads because only one thread is active at given time. This turns out to be a bottleneck as the application spends majority of time writing to the buffer.

Could someone please suggest a method to increase parallelism while writing to single buffer?

Many thanks in advance.

Answer 1

Have your threads write their data to a queue instead. Then, let a dedicated thread write from the queue to the buffer. If that is not concurrent enough, sacrifice the fixed ordering and use multiple queues.