Question

Scenario:
X_source = N/A.
Y_source = SQL server 2008 R2.
Z_source = CRM 2011 database.

I have a Y_source that will be updated daily with information from X_source at certain intervals. After that is done Z_source has to connect to the Y_source and upload that information. I have no control over X & Y source but do know that Y_source will be on the same network as the Z_source.

Problem:
Since I know that there are more than 200,000 records in Y_source I can’t just call all the records and upload them to the Z_source. I have to find a way where I can iterate through them either in batches or 1 by 1. The idea I have in mind is to use T-SQL cursor’s but this may seem like the wrong aprroach.

Sources:
I have the address and credentials to both Y & Z. I also have control over Z_source.

Edit
Ok let me clear some things out that I think may be important.:

1. Z_source is indeed a database that is separate from CRM 2011 but it is the origin of it’s source.

2. Also the process that updates Z_source can be an external process from CRM 2011. Which means as long as the Database is updated it does not matter if CRM triggered the update or not.

3. The amount of Records to be handled will be well over 200,000.

Answer 1

The solution that I came up was to create a C# console application to connect to the Y_source retrieve the data then with the CRM 2011 SDK use the quickstart app in: Sdk/samplecode/cs/quickstart and modified it to insert in Z_source. This app will run via a Windows Task 6 hours after the Y_source gets updated so yeah I don’t need a precise trigger for this.