how many types of remove the duplicate records?
Answer Posted / soumya
1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'
2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.
Is This Answer Correct ? | 1 Yes | 2 No |
Post New Answer View All Answers
Why do we use exception activity in Datastage?
Explain Quality stage?
What are the steps required to kill the job in Datastage?
What is the difference between operational data stage (ods) and data warehouse?
how to add a new records into source?
What are some different alternative commands associated with "dsjob"?
Explaine the implimentation of scd's in ds indetail, please send me step by step procedure to perform scd's 1,2,3. Please replay for this, Thanks in advance
What is size of a transaction and an array means in a datastage?
What is ds designer?
Explain the datastage parallel extender (px) or enterprise edition (ee)?
if i have two tables table1 table2 1a 1a,b,c,d 1b 2a,b,c,d,e 1c 1d 2a 2b 2c 2d 2e how can i get data as same as in tables? how can i implement scd typ1 and type2 in both server and in parallel? field1 field2 field3 suresh , 10,324 , 355 , 1234 ram , 23,456 , 450 , 456 balu ,40,346,23 , 275, 5678 how to remove the duplicate rows,inthe fields?
What are the stages in datastage?
What are routines in datastage? Enlist various types of routines.
Can you define merge?
What are the functionalities of link partitioner and link collector?