How do we eliminate duplicate records in a flat file without using Sorter and Aggregator?

Answer Posted / joe

Option 1: using Unix for flat files

Option2: Using Checksum function in the expression to
generate a unique hexadecimal code for each record.
and comparing the same with the next record.

Is This Answer Correct ?    5 Yes 2 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the sql query overwrite in source qualifier in informatica

812


In warehouses how many schemas are there?

779


Explain scd type 3 through mapping.

763


What do you mean incremental aggregation?

802


Design a mapping to load the cumulative sum of salaries of employees into target table?

1174


What are the tasks that can be performed using sq?

815


how tokens will generate?

1926


What are the transformations that are not supported in mapplet?

773


What do you mean by filter transformation?

741


How to extract sap data using informatica? What is abap? What are idocs?

795


Different sorts of metadata that stores in the storage facility?

764


what are the best practices to extract data from flat file source which are bigger than 100 mb memory?

2125


can we override a native sql query within informatica? Where do we do it?

855


can anyone suggest best free Talend data integration training online

1466


Explain dynamic target flat file name generation in informatica

831