Home/ Questions/Q 8815521
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-14T04:24:02+00:00

I have a really large table that I am not able to extract. This

  • 0

I have a really large table that I am not able to extract. This table is extracted thanks to the proprietary database ODBC driver that I link into an ADO.NET Source.

The source table has 90,000 rows and 333 columns. I only convert 3 columns between extraction and loading into an Oracle database.

Everytime I run the package, it fails after 66,500 rows loaded with an OutOfMemoryException. I tried to change the batch size to really low value like 10 or 50 but it still fails.

Screenshot of my dataflow:

enter image description here

NB: For other tables from this database I had to lower batch size under 300 because the amount of column was exceeding the number of available parameters for generated insert queries and was causing the package to fail.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    So I finally came up with a solution some times after posting this issue. I simply ended up setting the BatchSize to 1 on the destination for this particular package and it worked. This is the only package where I encountered the issue.

    • 0