How to remove duplicates in transformer stage? in parallel
mode

Answer Posted / praveen sarva

STEP 1) TRANSFORMER STAGE PROPERTIES--> ADVANCED -->
EXECUTION MODE ---> PARLLEL

STEP 2) TRANSFORMER STAGE PROPERTIES --> INPUT -->
PARTITIONING--> PARTITION TYPE --> HASH ---> ENABLE SORT ---
> ENABLE UNIQUE

Simple u will get non duplicate records....

Is This Answer Correct ?    11 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

How do you run datastage job from the command line?

605


What is usage analysis in datastage?

821


How to read multiple files using a single datastage job if files have the same metadata?

744


Can you filter data in hashed file?

3353


Give an idea of system variables.

593






file having these input and we have to get 3 output using same job Input 1 1 1 2 3 4 4 4 o/p1 o/p2 o/p3 1 1 2 2 1 3 3 1 4 4 4

545


What is the difference between datastage and datastage tx?

600


What are the main differences you have observed between 7.x and 8.x version of datastage?

626


How do you generate sequence number in datastage?

628


What is a ds designer?

645


How a source file is populated?

620


project Steps,hits, Project level HArd things,Solved methods?

1641


Can you explain link buffering?

731


hi.... am facing typical problem in every interview " I need some critical scenarios faced in real time" plz help me guys

2429


Can you explain repository tables in datastage?

909