how to remove duplicates in transformer stage by using
stage variables?one example?

Answers were Sorted based on User's Feedback



how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / ds

In Stage variable:

stage_variable3 <map> stage_variable1
if column=stage_variable1 than 0 else 1 <map>
stage_variable2
column <map> stage_variable3

Put stage_variable2 as constrain to target stage.

Is This Answer Correct ?    12 Yes 2 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / venu

if you want to remove duplicates in transformer stage
use one of the partition technic hash partition you can
easily remove duplicatess

Is This Answer Correct ?    8 Yes 2 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / peeyush sehgal

sv1=inputlink
sv2=if inputlink=sv3 then 1 else 0
sv3=sv1

Is This Answer Correct ?    0 Yes 2 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / prasad

take two stage variables

sV1: Input_column

sV2: if Input_column = sV1 then 0 else 1

and put 'sV1=1' as constraint

Plz correct me, If am wrong.....

Is This Answer Correct ?    4 Yes 7 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / amit

using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.

This will remove duplicate in transformer stage.

Is This Answer Correct ?    0 Yes 7 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / subodh

duplication of transformer stage is removed b7y using a
call by referance and call by value , using we create one
object and no other duplication is done

Is This Answer Correct ?    1 Yes 14 No

Post New Answer

More Data Stage Interview Questions

Why do you need stage variables?

0 Answers  


What is exact difference between Parallel Jobs and server Jobs..

7 Answers   IBM,


root tree will find which is server job and which is parallel job?

0 Answers   IBM,


Define oconv () and iconv () functions in datastage?

0 Answers  


How to read multiple files at different directories using a single Sequential File stage in DS Enterprise Edition

6 Answers   TCS,


Differentiate between data file and descriptor file?

0 Answers  


In the source seq file have 2 columns, i.e input: col1,col2 1,1 2,rajesh 3,15000 4,2 5,suresh 6,16000 7,3 8,veeru 9,17000 I want in the output like: eno,ename,sal 1,rajesh,15000 2,suresh,16000 3,veeru,17000 any one answer this scenario

3 Answers  


If you want to use a same piece of code in different jobs, how will you achieve this?

0 Answers  


3) Sequential file contains data like Empno ename sal 111 abc 2000 Trgt file: Trgt1----111 Trgt2----abc Trgt3---2000

2 Answers  


Give an idea of system variables.

0 Answers  


Differentiate between datastage and datastage tx?

0 Answers  


I have a few records just I want to store data in to targets cycling way how?

0 Answers   Polaris,


Categories