How do we eliminate duplicate records in a flat file without using Sorter and Aggregator?
Answer Posted / isha
Select all source rows.
The Dynamic Lookup transformation builds the caches from the target table.
When the lookup evaluates a row from the source that does not exist in the lookup cache, it inserts the row into the cache and assigns the NewLookupRow output port the value of 1. When the lookup evaluates a row from the source that exists in the lookup cache, it does not insert the row into cache and assigns the NewLookupRow output port the value of 0.
The filter in this mapping checks if the row is a duplicate or not by evaluating the NewLookupRow output port from the Lookup. If the value of the port is 0, the row is filtered out, as it is a duplicate row. If the value of the port is not equal to 0, then the row is passed out to the target table.
Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
Explain the pipeline partition with real time example?
How do you convert single row from source into three rows into target?
what is the hint? how to use it to reduce the query processing in program?
How to call shell scripts from informatica?
Can we use the mapping parameter or variables developed in one mapping into any other reusable transformation?
What are the conditions needed to improve the performance of informatica aggregator transformation?
How to create or implement slowly changing dimension (SCD) Type 2 Effective Date mapping in informatica/Flagging mapping in informatica/visioning mapping in informatica?
What is standalone command task?
wat are deployement groups in informatica, how it will be used for developers
Can we create a node as a gateway node and the same node can be assigned to a grid?
What are the types of caches in lookup?
Some flat files are there, out of these having some duplicate. How do you eliminate duplicate files while loading into targets?
Informatica Checkpoints
What is the need of etl tools?
What are the tasks that can be performed using sq?