how to remove duplicates in transformer stage by using
stage variables?one example?

Answer Posted / amit

using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.

This will remove duplicate in transformer stage.

Is This Answer Correct ?    0 Yes 7 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Can anyone tell me a difficult situation who have handled while creating Datastage jobs?

2934


1.new record it will insert but changes of natural key is not present in taget i want to update (here key is composite natural key )can any one help this to explan how to do

1749


explain about completely flow of sequencers technicaly,without using example??explain about lookup,nullhandling?

2017


What is the difference between the local container and shared container?

732


Define data aggregation?

779






what are .ctl(control files) files ? how the dataset stage have better performance by this files?

2292


What are the differences between datastage and informatica?

681


root tree will find which is server job and which is parallel job?

1536


Why do you need stage variables?

801


Why do we use link partitioner and link collector in datastage?

784


Name the third party tools that can be used in datastage?

715


Explain datastage architecture?

928


Explain the datastage parallel extender (px) or enterprise edition (ee)?

850


What are the main differences you have observed between 7.x and 8.x version of datastage?

705


What is quality stage?

661