Does someone have any tips/advice on database design for a web application? The kind of stuff that can save me a lot of time/effort in the future when/if the application I’m working on takes off and starts having a lot of usage.
To be a bit more specific, the application is a strategy game (browser based, just text) that will mostly involve players issuing ‘orders’ that will be stored in the database and processed later, with the results also being stored there (the history of ‘orders’ and the corresponding results will probably get quite big).
Edited to add more details (as requested):
platform: Django
database engine: I was thinking of using MySQL (unless there’s a big advantage in using another)
the schema: all I have now are some Django models, and that’s far too much detail to post here. And if I start posting schemas this becomes too specific, and I was looking for general tips. For example, consider that I issue ‘orders’ that will be later processed and return a result that I have to store to display some kind of ‘history’. In this case is it better to have a separate table for the ‘history’ or just one that aggregates both the ‘orders’ and the result? I guess I could cache the ‘history’ table, but this would take more space in the database and also more database operations because I would have to constantly create new rows instead of just altering them in the aggregate table.
You have probably touched on a much larger issue of designing for high scalability and performance in general.
Essentially, for your database design I would follow good practices such as adding foreign keys and indexes to data you expect to be used frequently, normalise your data by splitting it into smaller tables and identify which data is to be read frequently and which is to be written frequently and optimise.
Much more important than your database design for high performance web applications, is your effective use of caching both at the client level through HTML page caching and at the server level through cached data or serving up static files in place of dynamic files.
The great thing about caching is that it can be added as it is needed, so that when your application does take off then you evolve accordingly.
As far as your historical data is concerned, this is a great thing to cache as you do not expect it to change frequently. If you wish to produce regular and fairly intensive reports from your data, then it is good practise to put this data into another database so as not to bring your web application to a halt whilst they run.
Of course this kind of optimisation really isn’t necessary unless you think your application will warrant it.