How to remove duplicates in transformer stage? in parallel
mode

Answer Posted / kiran

partition the data by key and sort the data and click on
unique value. This will automatically delete duplicate
data.

Is This Answer Correct ?    20 Yes 3 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Explain Quality stage?

673


What is the different type of jobs in datastage?

581


How do you reject records in a transformer?

634


What are the steps needed to create a simple basic datastage job?

667


What is meta stage?

581






What is a merge in datastage?

774


How the ipc stage work?

680


Define repository tables in datastage?

706


Can you explain kafka connector?

781


how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara

369


What is the roundrobin collector?

643


How many Key we can define in remove duplicate stage?

824


Can anyone tell me a difficult situation who have handled while creating Datastage jobs?

2848


How you can fix the truncated data error in datastage?

1210


Can you explain tagbatch restructure operator?

707