how to remove duplicates in transformer stage by using
stage variables?one example?

Answer Posted / amit

using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.

This will remove duplicate in transformer stage.

Is This Answer Correct ?    0 Yes 7 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

How do you import and export the datastage jobs?

928


What is the difference between account and directory options ?

869


What are the stages in datastage?

825


What is the difference between in process and inter process?

896


What is quality stage?

765


What a datastage macro?

836


What is "fatal error/rdbms code 3996" error?

921


What is the precedence of stage variables,derivations, and constraints?

800


Where do the datastage jobs get stored?

945


How do you import and export data into datastage?

950


What is difference between join, merge and lookup stage?

845


I/p : F1 table have A,B,C,D,E and F2 table having C,E,V i need output 0utput1: ABD output2: V any one suggest me this

804


Highlight the main features of datastage?

824


if we using two sources having same meta data and how to check the data in two sources is same or not? and if the data is not same i want to abort the job ?how we can do this?

1988


What are the functionalities of link partitioner and link collector?

787