There are many solutions geared toward implementing “user-space” threads. Be it golang.org goroutines, python’s green threads, C#’s async, erlang’s processes etc. The idea is to allow concurrent programming even with a single or limited number of threads.
What I don’t understand is, why are the OS threads so expensive? As I see it, either way you have to save the stack of the task (OS thread, or userland thread), which is a few tens of kilobytes, and you need a scheduler to move between two tasks.
The OS provides both of this functions for free. Why should OS threads be more expensive than “green” threads? What’s the reason for the assumed performance degradation caused by having a dedicated OS thread for each “task”?
I want to amend Tudors answer which is a good starting point. There are two main overheads of threads:
(1) is only a problem if you are creating and stopping them all the time. This is solved commonly using thread pools. I consider this problem to be practically solved. Scheduling a task on a thread pool usually does not involve a trip to the kernel which makes it very fast. The overhead is on the order of a few interlocked memory operations and a few allocations.
(2) This becomes important only if you have many threads (> 100 or so). In this case async IO is a means to get rid of the threads. I found that if you don’t have insane amounts of threads synchronous IO including blocking is slightly faster than async IO (you read that right: sync IO is faster).