How do we eliminate duplicate records in a flat file without using Sorter and Aggregator?

Answer Posted / ankur saini

sol--seq gen---rank ---filter

add a sequence generator ...

ex input is
1 a
1 b
2 a
2 b
after seq generator
1 a 1
1 b 2
2 a 3
2 b 4

then ranl it group by all file ports rank on the seq gen key
input seq rank
1 a 1 1
1 b 2 2
2 a 3 1
2 b 4 2

add filter on rank=1

enjoy!!!!!

Is This Answer Correct ?    2 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Why sorter is an active transformation?

941


What is enterprise data warehousing?

787


explain about unit testing? in real time?

1893


One of the optimizing technique to improve the session performance is push down optimization,by using push down optimization we push as much as transformation logic to source/target database,but this degrades the d/b performance,how to overcome this?

1991


What all are steps in up gradation of Informatica server?

800


What are the restrictions of union transformation?

775


Differences between version 7.x and 8.x.

1630


Calculate sum of salaries department wise. Then the sum will be repeat for all columns in each department. Develop a mapping for this.

2088


Separate from an archive server and a powerhouse?

672


What are the advantages of informatica?

748


What are the data movement modes in informatica?

886


Is stop and abort are same in informatica?

749


How to call shell scripts from informatica?

749


How you know when to use a static cache and dynamic cache in lookup transformation?

1542


What are the guidelines to be followed while using union transformation?

862