I’m doing a “select sum(foo) from bar” query on a MySQL database that’s summing up 7.3mm records and taking about 22 seconds per run. Is there a trick to speeding up sums in MySQL?
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I’m doing a “select sum(foo) from bar” query on a MySQL database that’s summing up 7.3mm records and taking about 22 seconds per run. Is there a trick to speeding up sums in MySQL?
No, you can’t speed up the function itself. The problem here is really that you’re selecting 7.3 million records. MySQL has to scan the entire table, and 7.3 million is a pretty big number. I’m impressed that it finishes that fast, actually.
A strategy you could employ would be to break your data into smaller subsets (perhaps by date? Month?) and maintain a total sum for old data that’s not going to change. You could periodically update the sum, and the overall value could be calculated by adding the sum, and any new data that’s been added since then, which will be a much smaller number of rows.