I have an analytics database where I make complex queries. Each of these queries generates thousands of rows. I want to store these results in some kind of on disk cache so I can get the results later on. I can’t insert the results back into the database where the results came from as that database is read only. The requirements of this cache are.
- Very very fast to insert rows. MySQL is a non-starter.
- Fast to filter and sort the results
- No multi-table joins required
- No transactions
I’m interested to hear of any SQL or NoSQL solutions that can help with this.
You should probably take a look at NoSQL solutions. Maybe Cassandra, http://cassandra.apache.org/ which is used by facebook and digg among others