how many types of remove the duplicate records?

Answer Posted / rohit babar

There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.

2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false

3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records

Is This Answer Correct ?    5 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the difference between Datastage 7.5 and 7.0?

876


Explain datastage architecture?

1080


I have a few records just I want to store data in to targets cycling way how?

2129


how many rows sorted in sort stage by default in server jobs

3756


What are the types of jobs we have in datastage?

870


How to perform incremental load in datastage?

907


How will you move hashed file from one location to another location?

1898


What is apt_config in datastage?

918


1)what is the size of Fact table and dimension table? 2)how to find the size of Fact table and dimension table? 3)how to implement the surrogate key in transform stage? 4)write the configuration file path? 5)how many types of datasets explain? 6)diff b/w developed projects and migration projects? 7)how to delete the header and footer file of the sequencer file? 8)how can u call the parameters in DS in unix environment? 9) how much data ur getting daily ? 10)

2505


how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara

591


Can you explain engine tier in information server?

878


Can you explain players in datastage?

960


What are the job parameters?

928


explain about completely flow of sequencers technicaly,without using example??explain about lookup,nullhandling?

2182


how to export or import the jobs in .ISX file

952