Question

I have a function that is called millions of times, and the work done by this function is multithreaded. Here is the function:

void functionCalledSoManyTimes()
{
  for (int i = 0; i < NUM_OF_THREADS; i++)
  {
    pthread_create(&threads[i], &attr, thread_work_function, (void *)&thread_data[i]);
  }
  // wait
}

I’m creating the threads each time the function is called, and I give each thread its data struct (that’s been set once at the beginning of the algorithm) to use in the thread_work_function. The thread_work_functionsimply processes a series of arrays, and the thread_data struct contains pointers to those arrays and the indices that each thread is responsible for.

Although multithreading the algorithm in this way did improve the performance by more than 20%, my profiling shows that the repetitive calls to pthread_create are causing a significant overhead.

My question is: Is there a way to achieve my goal without calling pthread_create each time the function is called?

Problem Solved.

Thank you guys, I really appreciate your help! I’ve written a solution here using your tips.

Answer 1

Just start a fixed set of threads and use an inter-thread communication system (ring buffer, for instance) to pass the data to process.