Sort the incoming data using a sort stage & use remove duplicates on

Hi This is Vijay,

How can your remove the duplicates in sequential File?

Question Posted / arun

Answer Posted / arun

Sort the incoming data using a sort stage & use remove
duplicates on the key columns. This will remove the
duplicates in ur source file.

Is This Answer Correct ?

5 Yes

3 No

Please Help Members By Posting Answers For Below Questions

Explain usage analysis in datastage?

655

Hi, what is use of Macros,functions and Routines..? At what situation you are used. If you know the answer please explain it. Thanks.

1619

What is ibm datastage?

607

Triggers,VIEW,Procedures

802

how to implement scd2 in datastage 7.5 with lookup stage

5131

Can you filter data in hashed file?

3347

What is difference between join, merge and lookup stage?

638

What is staging variable?

624

What is ds designer?

657

Why do we use link partitioner and link collector in datastage?

685

What is the use of datastage director?

590

What is difference between symmetric multiprocessing and massive parallel processing?

655

WAT TYPE OF PL/SQL QUERRYS USED IN DATASTAGE

3271

options available in sequence job to run,validate?

840

what is ds administrator used for?

722