As a side project I’m currently writing a server for an age-old game I used to play. I’m trying to make the server as loosely coupled as possible, but I am wondering what would be a good design decision for multithreading. Currently I have the following sequence of actions:
- Startup (creates) ->
- Server (listens for clients, creates) ->
- Client (listens for commands and sends period data)
I’m assuming an average of 100 clients, as that was the max at any given time for the game. What would be the right decision as for threading of the whole thing? My current setup is as follows:
- 1 thread on the server which listens for new connections, on new connection create a client object and start listening again.
- Client object has one thread, listening for incoming commands and sending periodic data. This is done using a non-blocking socket, so it simply checks if there’s data available, deals with that and then sends messages it has queued. Login is done before the send-receive cycle is started.
- One thread (for now) for the game itself, as I consider that to be separate from the whole client-server part, architecturally speaking.
This would result in a total of 102 threads. I am even considering giving the client 2 threads, one for sending and one for receiving. If I do that, I can use blocking I/O on the receiver thread, which means that thread will be mostly idle in an average situation.
My main concern is that by using this many threads I’ll be hogging resources. I’m not worried about race conditions or deadlocks, as that’s something I’ll have to deal with anyway.
My design is setup in such a way that I could use a single thread for all client communications, no matter if it’s 1 or 100. I’ve separated the communications logic from the client object itself, so I could implement it without having to rewrite a lot of code.
The main question is: is it wrong to use over 200 threads in an application? Does it have advantages? I’m thinking about running this on a multi-core machine, would it take a lot of advantage of multiple cores like this?
Thanks!
Out of all these threads, most of them will be blocked usually. I don’t expect connections to be over 5 per minute. Commands from the client will come in infrequently, I’d say 20 per minute on average.
Going by the answers I get here (the context switching was the performance hit I was thinking about, but I didn’t know that until you pointed it out, thanks!) I think I’ll go for the approach with one listener, one receiver, one sender, and some miscellaneous stuff 😉
I write in .NET and I’m not sure if the way I code is due to .NET limitations and their API design or if this is a standard way of doing things, but this is how I’ve done this kind of thing in the past:
A queue object that will be used for processing incoming data. This should be sync locked between the queuing thread and worker thread to avoid race conditions.
A worker thread for processing data in the queue. The thread that queues up the data queue uses semaphore to notify this thread to process items in the queue. This thread will start itself before any of the other threads and contain a continuous loop that can run until it receives a shut down request. The first instruction in the loop is a flag to pause/continue/terminate processing. The flag will be initially set to pause so that the thread sits in an idle state (instead of looping continuously) while there is no processing to be done. The queuing thread will change the flag when there are items in the queue to be processed. This thread will then process a single item in the queue on each iteration of the loop. When the queue is empty it will set the flag back to pause so that on the next iteration of the loop it will wait until the queuing process notifies it that there is more work to be done.
One connection listener thread which listens for incoming connection requests and passes these off to…
A connection processing thread that creates the connection/session. Having a separate thread from your connection listener thread means that you’re reducing the potential for missed connection requests due to reduced resources while that thread is processing requests.
An incoming data listener thread that listens for incoming data on the current connection. All data is passed off to a queuing thread to be queued up for processing. Your listener threads should do as little as possible outside of basic listening and passing the data off for processing.
A queuing thread that queues up the data in the right order so everything can be processed correctly, this thread raises the semaphore to the processing queue to let it know there’s data to be processed. Having this thread separate from the incoming data listener means that you’re less likely to miss incoming data.
Some session object which is passed between methods so that each user’s session is self contained throughout the threading model.
This keeps threads down to as simple but as robust a model as I’ve figured out. I would love to find a simpler model than this, but I’ve found that if I try and reduce the threading model any further, that I start missing data on the network stream or miss connection requests.
It also assists with TDD (Test Driven Development) such that each thread is processing a single task and is much easier to code tests for. Having hundreds of threads can quickly become a resource allocation nightmare, while having a single thread becomes a maintenance nightmare.
It’s far simpler to keep one thread per logical task the same way you would have one method per task in a TDD environment and you can logically separate what each should be doing. It’s easier to spot potential problems and far easier to fix them.