how to remove duplicates in transformer stage by using
stage variables?one example?

Answer Posted / venu

if you want to remove duplicates in transformer stage
use one of the partition technic hash partition you can
easily remove duplicatess

Is This Answer Correct ?    8 Yes 2 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Which algorithm you used for your hashfile?

886


Difference between IBM DATA STAGE8.5 and DATA STAGE9.1 ?

3575


To see hidden files in LINIX?

1169


Difference between ‘validated ok’ and ‘compiled’ in data stage?

886


1)How will u implement SCD2 by using surrogate key. 2)What are the disadvantages with surrogate key. 3)How will you handle nulls in your project for the varchar, integer data types. 4)Can I use two fact tables in star schema. 5)3 jobs are running on the 2 nodes after I added one more node so can I compile those jobs to run on three nodes.

3746


what is ds administrator used for?

918


What is difference between symmetric multiprocessing and massive parallel processing?

862


1.what is repartionoing technique? 2.what deliverables transferred to client using datastage? 3.how to write loop statements using nested loop sequence?

1996


Hi , Can anyone give few examples of scenarios and there corresponding design in datastage..i am new to this tool...confused in design while my manager asking to design the job.. Please post the URL if there..so i can go through it.. Thanks in advance...

3946


hi iam new to this tooliam cmpltied to know abt datastage so now iam in project tell me whole step by step what iam doing iwnt to go with exp so plz hlp me pals

1666


1)s.key generate 1 to 700 records today. tomorrow another 400 will updated how to update the records using s.key generator? 2)source is like :-- DB --> T/F stage1 --> seq1file T/f 1 is linking with T/F2 ---> seq 2 how to load the data? in source i given some conditions those r going in seq1. The another data will going to seq2 how to do this ?

1821


how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara

583


How to implement complex jobs in data stage?

852


what is repositery?

1532


How a server job can be converted to a parallel job?

847