How do we eliminate duplicate records in a flat file without using Sorter and Aggregator?
Answer Posted / isha
Select all source rows.
The Dynamic Lookup transformation builds the caches from the target table.
When the lookup evaluates a row from the source that does not exist in the lookup cache, it inserts the row into the cache and assigns the NewLookupRow output port the value of 1. When the lookup evaluates a row from the source that exists in the lookup cache, it does not insert the row into cache and assigns the NewLookupRow output port the value of 0.
The filter in this mapping checks if the row is a duplicate or not by evaluating the NewLookupRow output port from the Lookup. If the value of the port is 0, the row is filtered out, as it is a duplicate row. If the value of the port is not equal to 0, then the row is passed out to the target table.
| Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
Define filter transformation?
I have done MBA in 2008. i got job as business analyst in 2008 january through consultany. but after 3 months they are giving training Informatica developer. now iam continuing this job. my question is when iam going to interview HR people ask me many times like this " YOU ARE MBA GRADUATE. HOW YOU ARE SELECT THIS POSTION. IAM EXPLAINING WHAT I HAVE MENTION ABOVE". PLEASE TELL HOW IAM TELLING THIS QUESTION ANSWER.
What is the difference between informatica 7.0 and 8.0?
What is substr in informatica?
What is lookup change?
What is a router transformation?
What are the tasks that source qualifier perform?
Can we create a Integration service without a Repository service and vice versa?
How do you load first and last records into target table? How many ways are there to do it? Explain through mapping flows.
What is the commit type if you have a transaction control transformation in the mapping?
Difference between Data and Index Caches?
How can informatica be used for an organization?
How does a sorter cache works?
Suppose we do not group by on any ports of the aggregator what will be the output?
What is meant by incremental aggregation?