I am working on a project that needs to import a csv file once a week for sale leads into SQL Server 2000. This file is rather large. I also need to make sure no duplicate records are imported into the database and keep track of how many records are duplicates and how many records are new leads. Any ideas, suggestions, or a good tutorial on this? Anyone done something similar?

Lets say you have a cvs file name master

In your DTS Transform data Task Properties select SQL Query
and select a select statement
SELECT distinct [MASTER$].*
FROM [MASTER$]

In the Destination tab, select the table name you are importing to
and in the transformations tab map the columns from the cvs ( select statement from the source) to the database.

what you have done is queried the cvs file and selected the distinct data; just like query analyzer.


Jaime E. Maccou