Question

im wondering how you would ensure that the results returned from a SProc, and stored in a datatable, are not too large to be handled in memory.

Ive had a dig already and found the following Find size of object instance in bytes in c# but the selected answer suggests not doing this.

Im assuming this is an issue which has been solved before so id appreciate any pointers.

Thanks.

Answer 1

You may want to implement paging.

To do this, add @pageNum and @pageSize parameters to your SP and change the query:

SELECT  *
FROM    (
        SELECT  *, ROW_NUMBER() OVER (ORDER BY whatever_field) rn
        FROM    (
--              here goes the old query
                ) q
        WHERE   rn BETWEEN @pageSize * @pageNum + 1 AND @pageSize * (@pageNum + 1)
        ) q
ORDER BY
        wnatever_field