How do we eliminate duplicate records in a flat file without using Sorter and Aggregator?
Answer Posted / isha
Select all source rows.
The Dynamic Lookup transformation builds the caches from the target table.
When the lookup evaluates a row from the source that does not exist in the lookup cache, it inserts the row into the cache and assigns the NewLookupRow output port the value of 1. When the lookup evaluates a row from the source that exists in the lookup cache, it does not insert the row into cache and assigns the NewLookupRow output port the value of 0.
The filter in this mapping checks if the row is a duplicate or not by evaluating the NewLookupRow output port from the Lookup. If the value of the port is 0, the row is filtered out, as it is a duplicate row. If the value of the port is not equal to 0, then the row is passed out to the target table.
| Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
How to join three sources using joiner? Explain though mapping flow.
What is the cumulative sum and moving sum?
Write the unconnected lookup syntax?
What is the Process to creating lookup transformation in informatica
How do you use reject loader.
Enlist the differences between database and data warehouse.
How to create a non-reusable instance of reusable transformations?
Tell me about Propagate functions in informatica
Explain dynamic target flat file name generation in informatica
Design time, run time. If you don't create parameter what will happen
What is the command used to run a batch?
Can we use the mapping parameters or variables created in one mapping into any other reusable transformation?
Informatica Checkpoints
How to load last n records of file into target table - informatica
What does role playing dimension mean?