I have source file which contains duplicate data,my
requirement is unique data should pass to one file and
duplicate data should pass another file how?

Answer Posted / dilip anand k

Its Simple!!

All you have to do is link your source to a Sort Stage.
Sort the data and generate a Key Change column.
Key Change column = ‘1’ represents that the record is
unique while Key Change Column = ‘0’ represents the
duplicates.

Put a Filter stage and filter out the data into two
different outputs based on the generated Key Change Column.

Is This Answer Correct ?    21 Yes 5 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

How to convert RGB Value to Hexadecimal values in datastage?

3702


how many rows sorted in sort stage by default in server jobs

3763


Can you explain players in datastage?

970


What is the difference between passive stage and active stage?

1099


root tree will find which is server job and which is parallel job?

1656


How to find value from a column in a dataset?

1964


What is difference between symmetric multiprocessing and massive parallel processing?

889


How can we improve the performance in datastage?

876


What are some different alternative commands associated with "dsjob"?

900


How do you remove duplicate values in datastage?

872


What is the difference between in process and inter process?

915


What is the difference between an operational datastage and a data warehouse?

878


Different ways a project can be moved to production ?...example ….export-import and Version control.

2200


In Informatica,for the table I can find coreesponding dependent mappings.Likewise can I find the dependent jobs with all the information by using the table name

2237


Define data aggregation?

882