how many types of remove the duplicate records?
Answer Posted / soumya
1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'
2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.
| Is This Answer Correct ? | 1 Yes | 2 No |
Post New Answer View All Answers
What are the processing stages?
What is the sortmerge collector?
disign the complex job in u r project?(they are aksing only complex job design and then data flow...)
What is process model?
How a server job can be converted to a parallel job?
Hi everyone,I have kept a project Sales And Distribution for a pharmaceutical company.can anybody explain one complex business rule that we had in our project and how did you accomplish it using DS?
Can you implement SCD2 using join, transformer and funnel stage?
In Informatica,for the table I can find coreesponding dependent mappings.Likewise can I find the dependent jobs with all the information by using the table name
What is the process of killing a job in datastage?
how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara
i have a job with 3 possibiliies finish with ststus ok abbort warning how do you handle these 3 in job sequence? explain the situation where you have appiled scd in your project? chandu
What is active and passive stage?
Is the value of staging variable stored temporarily or permanently?
How to perform incremental load in datastage?
Is it possible to query a hash file?