Interested to Buy Any Domain ? << Click Here >> for more details...
Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
- 2 Answers
- 5516 Views
- I also Faced
- E-Mail Answers
Answer Posted / vz
Put a constraint in Transformer stage as shown bellow.
flag1=y or flag2=y
means
feald1=y or feald2=y
I think it's help you.
| Is This Answer Correct ? | 3 Yes | 1 No |
Post New Answer View All Answers
What all the types of jobs you developed?
which r the connectors used in san?
What are iconv and oconv?
Can you explain repository tables in datastage?
How a server job can be converted to a parallel job?
explain about citrix scheduling tool in datastage
Can anyone tell me a difficult situation who have handled while creating Datastage jobs?
What is datastage?
What are the types of containers in datastage?
Differentiate between validated and Compiled in the Datastage?
What is a merge?
1)what is the size of Fact table and dimension table? 2)how to find the size of Fact table and dimension table? 3)how to implement the surrogate key in transform stage? 4)write the configuration file path? 5)how many types of datasets explain? 6)diff b/w developed projects and migration projects? 7)how to delete the header and footer file of the sequencer file? 8)how can u call the parameters in DS in unix environment? 9) how much data ur getting daily ? 10)
how to export or import the jobs in .ISX file
Difference between data warehousing and olap?
What all are the different way to run a job?
