Interested to Buy Any Domain ? << Click Here >> for more details...
I have source file which contains duplicate data,my
requirement is unique data should pass to one file and
duplicate data should pass another file how?
- 7 Answers
- 24609 Views
- CTS, I also Faced
- E-Mail Answers
Answer Posted / dilip anand k
Its Simple!!
All you have to do is link your source to a Sort Stage.
Sort the data and generate a Key Change column.
Key Change column = ‘1’ represents that the record is
unique while Key Change Column = ‘0’ represents the
duplicates.
Put a Filter stage and filter out the data into two
different outputs based on the generated Key Change Column.
| Is This Answer Correct ? | 21 Yes | 5 No |
Post New Answer View All Answers
Can you explain how could anyone drop the index before loading the data in target in datastage?
client know skid info?
whom do you report?
if i have two tables table1 table2 1a 1a,b,c,d 1b 2a,b,c,d,e 1c 1d 2a 2b 2c 2d 2e how can i get data as same as in tables? how can i implement scd typ1 and type2 in both server and in parallel? field1 field2 field3 suresh , 10,324 , 355 , 1234 ram , 23,456 , 450 , 456 balu ,40,346,23 , 275, 5678 how to remove the duplicate rows,inthe fields?
project Steps,hits, Project level HArd things,Solved methods?
how to connect source to db?generally what r stages u used? how to find the data is having delimiter format?
What are the important features of datastage?
How do you remove duplicate values in datastage?
What is difference between symmetric multiprocessing and massive parallel processing?
disign the complex job in u r project?(they are aksing only complex job design and then data flow...)
i WANTED TO USE THE RANGE LOOKUP SCENARIO IN DATASTAGE 7.5.2 SRVER JOB.i HAVE A DATE FIELD IN SOURCE AND I SHOULD MATCH IT WITH A FIELD IN LOOKUP FILE.BUT,THE FIELDS SHOULD MATCH EVEN THOUGH THERE IS SOME RANGE.CAN SOMEONE TELL ME HOW CAN I DO THAT. THANKS
What is difference between server jobs & parallel jobs?
in oracle target stage when we use load option and when we use upsert option?
Can you define merge?
What is the difference between validated and compiled in the datastage?
