Interested to Buy Any Domain ? << Click Here >> for more details...
Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
- 2 Answers
- 5626 Views
- I also Faced
- E-Mail Answers
Answer Posted / vz
Put a constraint in Transformer stage as shown bellow.
flag1=y or flag2=y
means
feald1=y or feald2=y
I think it's help you.
| Is This Answer Correct ? | 3 Yes | 1 No |
Post New Answer View All Answers
What is the use of hoursfromtime() function in transformer stage in datastage?
Hi everyone,I have kept a project Sales And Distribution for a pharmaceutical company.can anybody explain one complex business rule that we had in our project and how did you accomplish it using DS?
Can you highlight the main features of ibm infosphere information server?
Demonstrate experience in maintaining quality process standards?
what is ds administrator used for?
Can you filter data in hashed file?
How to manage date conversion in Datastage?
How can you write parallel routines in datastage PX?
How do you remove duplicate values in datastage?
What is the roundrobin collector?
hi.... am facing typical problem in every interview " I need some critical scenarios faced in real time" plz help me guys
Lookup constraints
What are some different alternative commands associated with "dsjob"?
How can we improve the performance in datastage?
Difference between sequential file and data set?
