I am getting 600,000 rows daily from my source and I need to dump them into the SQL Server destination, which would be an incremental load.
Now, as the destination table size is likely to be increase day by day which would be the best approach for the incremental load. I have few options in my mind:
-
Lookup Task
-
Merge Join
-
SCD
etc..
Please suggest me the best option which will perform well in incremental load.
Look at Andy Leonard’s excellent Stairway to Integration Services series or Todd McDermid’s videos on how to use the free SSIS Dimension Merge SCD component Both will address how to do it right far better than I could enumerate in this box.