How to remove duplicates in transformer stage? in parallel
mode

Answer Posted / prasad

Take 2 Stage variables in transformer stage

sV1 =Column_Name
sV2 =if Column_Name=sV1 Then 0 Else 1

put it constraint sV2=1 (only will get unique records)

if u want duplicates sV2=0

Is This Answer Correct ?    0 Yes 1 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

How will you move hashed file from one location to another location?

1665


How to read multiple files using a single datastage job if files have the same metadata?

748


How do you generate sequence number in datastage?

633


Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?

636


why do u need the IOS upgradation in a FC switch

1882






How will you load you daily/monthly jobs datas in to Fact and Dimension table using datastage.

3001


I have a few records just I want to store data in to targets cycling way how?

1907


How to write a expression to display the first letter in Caps in each word using transformer stage ? Please let me know ASAP Thanks in advance...

1090


how can we validate the flat files using the date in the header and number of records in the flat file? Using both conditions at a time.

2740


What is ibm datastage flow designer?

694


What are the types of containers?

701


What is the flow of loading data into fact & dimensional tables?

602


How you Implemented SCD Type 1 & Type 2 in your project?

3703


Why do we use exception activity in Datastage?

735


What is difference between symmetric multiprocessing and massive parallel processing?

664