how many types of remove the duplicate records?

Answer Posted / soumya

1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'

2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.  

Is This Answer Correct ?    1 Yes 2 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Why do we use exception activity in Datastage?

1003


Explain Quality stage?

903


What are the steps required to kill the job in Datastage?

938


What is the difference between operational data stage (ods) and data warehouse?

956


how to add a new records into source?

1735


What are some different alternative commands associated with "dsjob"?

878


Explaine the implimentation of scd's in ds indetail, please send me step by step procedure to perform scd's 1,2,3. Please replay for this, Thanks in advance

1966


What is size of a transaction and an array means in a datastage?

1030


What is ds designer?

849


Explain the datastage parallel extender (px) or enterprise edition (ee)?

980


if i have two tables table1 table2 1a 1a,b,c,d 1b 2a,b,c,d,e 1c 1d 2a 2b 2c 2d 2e how can i get data as same as in tables? how can i implement scd typ1 and type2 in both server and in parallel? field1 field2 field3 suresh , 10,324 , 355 , 1234 ram , 23,456 , 450 , 456 balu ,40,346,23 , 275, 5678 how to remove the duplicate rows,inthe fields?

1942


What are the stages in datastage?

828


What are routines in datastage? Enlist various types of routines.

857


Can you define merge?

863


What are the functionalities of link partitioner and link collector?

791