Question

My computer is a dual core core2Duo. I have implemented multithreading in a slow area of my application but I still notice cpu usage never exceeds 50% and it still lags after many iterations. Is this normal? I was hopeing it would get my cpu up to 100% since im dividing it into 4 threads. Why could it still be capped at 50%?

Thanks

See What am I doing wrong? (multithreading)

for my implementation, except I fixed the issue that that code was having

Answer 1

Looking at your code, you are making a huge number of allocations in your tight loop–in each iteration you dynamically allocate two, two-element vectors and then push those back onto the result vector (thus making copies of both of those vectors); that last push back will occasionally cause a reallocation and a copy of the vector contents.

Heap allocation is relatively slow, even if your implementation uses a fast, fixed-size allocator for small blocks. In the worst case, the general-purpose allocator may even use a global lock; if so, it will obliterate any gains you might get from multithreading, since each thread will spend a lot of time waiting on heap allocation.

Of course, profiling would tell you whether heap allocation is constraining your performance or whether it’s something else. I’d make two concrete suggestions to cut back your heap allocations:

• Since every instance of the inner vector has two elements, you should consider using a std::array (or std::tr1::array or boost::array); the array “container” doesn’t use heap allocation for its elements (they are stored like a C array).
• Since you know roughly how many elements you are going to put into the result vector, you can reserve() sufficient space for those elements before inserting them.