I have source file which contains duplicate data,my
requirement is unique data should pass to one file and
duplicate data should pass another file how?

Answer Posted / riyazahamedmohamed

take two links using copystage, of your input file,one is your input file output, another one is for keychange column(using sort stage set the key change column to true) with filter "0" out of transformer, to the look up stage.set the lookup option to continue-reject.you will get the desired output.reject will capture unique records.output file will capture duplicate records.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

How to read the length of word in unix?

1145


how to sort two columns in single job in datastage.

2733


What is the purpose of pivot stage?

865


1)what is the size of Fact table and dimension table? 2)how to find the size of Fact table and dimension table? 3)how to implement the surrogate key in transform stage? 4)write the configuration file path? 5)how many types of datasets explain? 6)diff b/w developed projects and migration projects? 7)how to delete the header and footer file of the sequencer file? 8)how can u call the parameters in DS in unix environment? 9) how much data ur getting daily ? 10)

2524


How can one find bugs in job sequence?

1059


what is repositery?

1568


Describe stream connector?

1066


What are the types of containers and how to create them?

774


How do you import and export data into datastage?

981


How to write a expression to display the first letter in Caps in each word using transformer stage ? Please let me know ASAP Thanks in advance...

1297


EXPLAIN SCD

1179


What are the components of datastage?

880


Explain ibm infosphere information server and highlight its main features?

862


Demonstrate experience in maintaining quality process standards?

2199


Differentiate between Join, Merge and Lookup stage?

878