how many types of remove the duplicate records?

Answer Posted / soumya

1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'

2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.  

Is This Answer Correct ?    1 Yes 2 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the difference between account and directory options ?

625


What all the types of jobs you developed?

667


Explaine the implimentation of scd's in ds indetail, please send me step by step procedure to perform scd's 1,2,3. Please replay for this, Thanks in advance

1754


Difference between data warehousing and olap?

654


What is oci?

858






What are the types of hashed files in data stage

647


Enlist various types of routines in datastage.

645


sed,awk,head

972


What are the differences between datastage and informatica?

571


What is the roundrobin collector?

642


What is datastage engine?

731


I have a few records just I want to store data in to targets cycling way how?

1903


what is repositery?

1298


what is the use of surogate key in datastage

1824


What are the types of containers in datastage?

706