Question

Today my boss and I were having a discussion about some code I had written. My code downloads 3 files from a given HTTP/HTTPS link. I had multi-threaded the download so that all 3 files are downloading simultaneously in 3 separate threads. During this discussion, my boss tells me that the code is going to be shipped to people who will most likely be running old hardware and software (I’m talking Windows 2000).

Until this time, I had never considered how a threaded application would scale on older hardware. I realize that if the CPU has only 1 core, threads are useless and may even worsen performance. I have been wondering if this download task is an I/O operation. Meaning, if an API is blocked waiting for information from the HTTP/HTTPS server, will another thread that wants to do some calculation be scheduled meanwhile? Do older OSes do such scheduling?

Another thing he said: Since the code is going to be run on old machines, my application should not eat the CPU. He said use Sleep() calls after CPU intensive tasks to allow other programs some breathing space. Now I was always under the impression that using Sleep() is terrible in any program. Am I wrong? When is using Sleep() justified?

Thanks for looking!

Answer 1

I have been wondering if this download task is an I/O operation.
Meaning, if an API is blocked waiting for information from the
HTTP/HTTPS server, will another thread that wants to do some
calculation be scheduled meanwhile? Do older OSes do such scheduling?

Yes they do. That’s the joke of having blocked IO. The thread is suspended and other calculations (threads) take place until an event wakes up the blocked thread. That’s why it makes completely sense to split it up into threads even for single core machines instead of doing some poor man scheduling between the downloads yourself in a single thread.

Of course your downloads affect each other regarding bandwith, so threading won’t help to speedup the download 🙂

Another thing he said: Since the code is going to be run on old
machines, my application should not eat the CPU. He said use Sleep()
calls after CPU intensive tasks to allow other programs some breathing
space.

Actually using sleep AFTER the task finished won’t help here. Doing Sleep after a certain time of calculation (doing sort of time slicing) before going on with the calculation could help. But this is only true for cooperative systems (e.g. like Windows 3.11). This does not play a role for preemptive systems where the scheduler uses time slicing to allocate calculation time to threads. Here it would be more important to think about lowering the priority for CPU intensive tasks in order to give other tasks precedence…

Now I was always under the impression that using Sleep() is terrible
in any program. Am I wrong? When is using Sleep() justified?

This really depends on what you are doing. If you implement sort of busy waiting for a certain flag being set which is set maybe after few seconds it’s better to recheck if it’s set after going to sleep for a while in order to give up your scheduled time slice instead of just buring CPU power with checking for a flag never being set.

In modern systems there is no sense in introducing Sleep in a calculation as it will only slow down your calculation.

Scheduling is subject to the OS’s scheduler. He’s the one with the “big picture”. In my opinion every approach to “do it better” is only valid inside the scope of a specific application where you have the overview over certain relationships that are not obvious to the scheduler.

Addendum:
I did some research and found that Windows supports preemptive multitasking from Windows 95. The Windows NT-line (where Windows 2000 belongs to) always supported preemptive multitasking.