I'm a few weeks into my new job as a SSIS data conversion guy and I'm starting to get a handle on a few things. However, I am having a few problems from poor data sent to us from an outside source. There are two main issues I have with various sources:

I solved my first problem, but i still need help on the second one:

2. I've avoided doing this second set of data soley because I know I don't know what to do with it. The data comes in two rows per actual dataset (I.E., the data is in two rows, but the destination should only have 1 row with condensed data). There is some duplicate data on the data rows, so obviously I want to take some data from both rows and send it to a database with only 1 row.

Any help, or steps in the right direction would be helpful.

a bump for changes.

Assuming that the two rows have a column that indicates they belong together (like an id field) but then has some other column that can be used to tell them apart (assume a column called Part), then use a self join like this

SELECT T1.ID, T1.otherdata, T2.otherdata_minus_the_data_that_isduplicated
FROM Table1 as T1
JOIN Table1 as T2
ON T1.ID = T2.ID AND T1.Part > T2.Part


David Lundell
Principal Consultant and Trainer
www.mutuallybeneficial.com