how many types of remove the duplicate records?

Answer Posted / rohit babar

There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.

2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false

3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records

Is This Answer Correct ?    5 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is ibm datastage?

608


What are the components of datastage?

659


What is size of a transaction and an array means in a datastage?

742


In Datastage, how you can fix the truncated data error?

641


whom do you report?

1504






Hi, what is use of Macros,functions and Routines..? At what situation you are used. If you know the answer please explain it. Thanks.

1622


How can one find bugs in job sequence?

790


What are the enhancements made in datastage 7.5 compare with 7.0?

712


Hi,can any one please mention list of dimension and fact tables for Sales and Distribution System for a Pharmacutical company.

1671


hi iam new to this tooliam cmpltied to know abt datastage so now iam in project tell me whole step by step what iam doing iwnt to go with exp so plz hlp me pals

1471


Which is the best institute in Hyderabad to learn OBIEE and DataStage?Please tell me faculty name also

2747


Can you highlight the main features of ibm infosphere information server?

640


Hi guys, Please design a job for dis requirement with derivation(solution). my source table like dis. emp_no qualification 1 a 1 c 2 a 3 c 3 b To loaded to target like dis emp_no qualification 1 b 2 b 2 c 3 a my requirement is every employer have three qualifications i.e a,b and c. what qualification missed in source table that will be move to target systems. Hope u got it the requirement. Right Thanks.

2431


Where the datastage stored his repository?

619


Whats difference betweeen operational data stage (ods) and data warehouse?

674