Home/ Questions/Q 7582253
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-05-30T18:23:27+00:00

I am currently using SSIS to read the data from a table, modify a

  • 0

I am currently using SSIS to read the data from a table, modify a column and inset it into a new table.

The modification I want to perform will occur if a previously read row has an identical value in a particular column.

My original idea was to use a c# script with a dictionary containing previously read values and a count of how many times it has been seen.

My problem is that I cannot save a dictionary as an SSIS variable. Is it possible to save a C# variable inside an SSIS script component? or is there another method I could use to accomplish this.

As an example, the data below

/--------------------------------\
| Unique Column | To be modified |
|--------------------------------|
|   X5FG        |      0         |
|   QFJD        |      0         |
|   X5FG        |      0         |
|   X5FG        |      0         |
|   DFHG        |      0         |
|   DDFB        |      0         |
|   DDFB        |      0         |

will be transformed into

/--------------------------------\
| Unique Column | To be modified |
|--------------------------------|
|   X5FG        |      0         |
|   QFJD        |      0         |
|   X5FG        |      1         |
|   X5FG        |      2         |
|   DFHG        |      0         |
|   DDFB        |      0         |
|   DDFB        |      1         |
Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    Rather than use a cursor, just use a set based statment

    Assuming SQL 2005+ or Oracle, use the ROW_NUMBER function in your source query like so. What’s important to note is the PARTITION BY defines your group/when the numbers restart. The ORDER BY clause directs the order in which the numbers are applied (most recent mod date, oldest first, highest salary, etc)

    SELECT
    D.*
,   ROW_NUMBER() OVER (PARTITION BY D.unique_column ORDER BY D.unique_column ) -1 AS keeper
FROM
(
    SELECT 'X5FG'
    UNION ALL SELECT 'QFJD'
    UNION ALL SELECT 'X5FG'
    UNION ALL SELECT 'X5FG'
    UNION ALL SELECT 'DFHG'
    UNION ALL SELECT 'DDFB'
    UNION ALL SELECT 'DDFB'
) D (unique_column)

    Results

    unique_column       keeper
DDFB                0
DDFB                1
DFHG                0
QFJD                0
X5FG                0
X5FG                1
X5FG                2
    • 0