I have to process and retrieve large Data sets fast and accurate. Performance is a must. I’ve tried many techniques but it wasn’t fast enough…
Any ideas??
Edit: Similar to http://msdn.microsoft.com/en-us/library/ms188774.aspx
Share
Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I have to process and retrieve large Data sets fast and accurate. Performance is a must. I’ve tried many techniques but it wasn’t fast enough…
Any ideas??
Edit: Similar to http://msdn.microsoft.com/en-us/library/ms188774.aspx
Using
SET ROW COUNTwould only limit the rows being returned and not improve performance, you could achieve the same results by using theTOPkeyword in your queries.Since you are dealing with large quantities of data and are trying to improve performance you could try some of the following techniques:
Add indexes to columns referenced in your queries.
Look at the execution plan of your queries and see the most expensive operations.
Use stored procedures, you will get the benefits of the execution plan as well as caching if the database engines detects queries with the same parameters.
Partition the tables, this could improve performance by splitting large quantities of data up into multiple tables based upon date ranges.
Run the database tuning wizard.