Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
Answer Posted / vz
Put a constraint in Transformer stage as shown bellow.
flag1=y or flag2=y
means
feald1=y or feald2=y
I think it's help you.
| Is This Answer Correct ? | 3 Yes | 1 No |
Post New Answer View All Answers
Difference between data warehousing and olap?
In Datastage, how you can fix the truncated data error?
Which warehouse using in your datawarehouse
describe the Steps to confiure a Qlogic switch
What are the types of containers and how to create them?
What are stage variables and constants?
How to RD using transformer?
Where do the datastage jobs get stored?
What is the sortmerge collector?
What are orabulk and bcp stages?
What is difference between join, merge and lookup stage?
Name the third party tools that can be used in datastage?
What is the command line function to import and export the ds jobs?
What are the various kinds of containers available in datastage?
How will you load you daily/monthly jobs datas in to Fact and Dimension table using datastage.