Interested to Buy Any Domain ? << Click Here >> for more details...
how many types of remove the duplicate records?
- 3 Answers
- 11500 Views
- Caterpillar, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / prabhu rathnam
1. remove duplicate stage
2. sort stage
3. copy stage
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / rohit babar
There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.
2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false
3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records
| Is This Answer Correct ? | 5 Yes | 0 No |
Answer / soumya
1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'
2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.
| Is This Answer Correct ? | 1 Yes | 2 No |
hi i am bhavani, in real time data stage who is the source provide? and how to recevied in developer? Pls send me answer
What is developer responsibilities in UAT (user acceptance testing and Post implementation phase?
What is the command line function to import and export the ds jobs?
2.how u run your rotines in unix? what is job sequencer? if i have 4 jobs i would like to run 2 jobs in server(using job jobsequencer)and remaining 2 in parallel?how can i run?
tab1 tab2 1,a 1,d 2,b 3,c perfoms outerjoin what is the o/p? write sql query for outerjoin?
if we using two sources having same meta data and how to check the data in two sources is same or not? and if the data is not same i want to abort the job ?how we can do this?
What is the default execution order of the sequential file?
why we use hash file for lookup?
What are the various kinds of the hash file?
Hi Friends, I have a input data like, class_id Marks 101 50 101 60 101 40 102 90 102 35 And i want my output data like class_id Marks Rank 101 50 2 101 60 1 101 40 3 102 90 1 102 35 2 how to do this in datastage?
8 Answers Cognizant, HCL, TIAA CREF,
What is the difference between server job and parallel jobs?
what is the main difference between sorragate key n primary key in one word
Teradata 
