Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I’ve never tried this – so I don’t know if I’d run into memory issues.
But can a SqlDataReader read a trillion records? It’s all streamed correct? I’m a little green to what the SQL/TDS protocol is doing under the covers.
UPDATE
Translate Trillion to mean very large number. I probably should have said something like 1 billion or 100 million.
Yes, that will stream… but I don’t think you should actually try to do it.
If you could read a million records per second (which sounds unlikely to me) you’d still need 12 days to read a trillion records… that’s a lot of work to risk losing half way through.
Now I realise you probably don’t really want to read a trillion records, literally, but my point is that if you can separate your “large amount” of work into logical batches anyway, that’s probably a good idea.