Question

I am working on a PHP / MySQL stat logging program and am trying to find the best MySQL DB Structure for it.

There is a part where visitors will be able to see up to the date stats (i.e the latest 20 entries) but also will be able to see today’s overall, yesterday’s overall, last 7 days overall and last 30 days overall stats.

From the data I’m pulling the real-time stats will be updated every 60 seconds with at least 10 new entries per update.

Is my logic correct to setup two tables … one to act as “today’s” stats and another to act as the overall archive … like:

todays_stats
id
from_url
entry_date

overall_stats
id
from_url
entry_date

Then double insert for each new entry but truncate the todays_stats at midnight every night via a cron job?

Or is there a more efficient way of doing this?

Answer 1

It depends on your daily stat row count, whether to delete historical data, and how much indexes you has. We need to delete historical data and has 7~8 indexes with large amount of stat data, so we separate data into daily tables and write stored procedures to fetch data(last day, last 7 day, last 30 day etc). Dropping table is much more faster than DELETE FROM table WHERE index=6-month-old-data