Home/ Questions/Q 8729389
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-13T08:49:28+00:00

While this seems like a basic problem, I’ve been ripping my hair out FOR

  • 0

While this seems like a basic problem, I’ve been ripping my hair out FOR DAYS trying to get an efficient solution to this.

I have a lookup table of values on a server that I read from and assemble into a string using a C# Script task. I write this string into a variable that I want to pass in as my WHERE parameters inside a large SQL query on a ADO.NET data source (from a different server which I only have read access to) in my data flow. For example, this string would just be something like

  ('Frank', 'John', 'Markus', 'Tom')

and I would append that as my WHERE clause.
I can’t read from a variable directly for an ADO.NET data source AND I can’t use the ‘Expression’ property to set my SQL either as my SQL query is over 4000 characters. I could use an Execute SQL Task to run my query, load the results into a recordset and I assume, then loop through the recordset but that’s extremely inefficient.

What would be the best way to do this? My end goal is to put these results inside a table on the first server.

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    You could try to set up Script Component as source – variables and strings inside scripts can be longer than 4000 characters so you can fit your query inside.

    Setup your component similar to this article: http://beyondrelational.com/modules/2/blogs/106/posts/11119/script-componentsource-part1.aspx
    In this one you have example how to fetch data using ExecuteReader and put it to output of script component: http://beyondrelational.com/modules/2/blogs/106/posts/11124/ssis-script-component-as-source-adonet.aspx In this one you have instructions how to aquire connection properly: http://www.toadworld.com/platforms/sql-server/b/weblog/archive/2011/05/30/use-connections-properly-in-an-ssis-script-task

    By joining this pieces of information you should be able to write your source Script Component which can fetch data using any length dynamically constructed query.

    Good luck 🙂

    • 0