How do we eliminate duplicate records in a flat file without using Sorter and Aggregator?

Answer Posted / joe

Option 1: using Unix for flat files

Option2: Using Checksum function in the expression to
generate a unique hexadecimal code for each record.
and comparing the same with the next record.

Is This Answer Correct ?    5 Yes 2 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the surrogate key?

741


Explain your project of banking domian.

1290


What does reusable transformation mean?

755


how we can load rejected record's at run time?(not through bad files)

2011


What do you understand by a term domain?

768






What is option by which we can run all the sessions in a batch simultaneously?

758


Explain where to store informatica rejected data? How to extract the informatica rejected data?

693


If I have 10 flat files with same name abc.txt files with different timestamps as source I need to load them in tgt table oracle. in between job execution fails and rows are not loaded into tgt. how can I make them load in that target even if my job fails?

1118


Debugger what are the modules, what are the options you can specify when using debugger, can you change the expression condition dynamically when the debugger is running.

1980


What is confirmed fact in dataware housing?

5914


What are the types of presistent cache in look up tr.

1671


How do you manage the Parameter files while migrating your data from one environment to another environment?

653


What is workflow manager?

667


How do you update the records with or without using update strategy?

755


What is parallel processing in informatica?

1153