Eliminating of duplicate records without using dynamic lookups

Answers were Sorted based on User's Feedback



Eliminating of duplicate records without using dynamic lookups..

Answer / jakka

Below are the ways to eliminate the duplicate records:
1.Select distinct in source qualifier
2.Based on your requirement,select and give number of
sorted ports in source qualifier and need to override the
query using order by cluase. Then use aggregator and select
sorted input as given and use group by ports
3. Use sorter to sort data and then use aggregator as
mentined in point 2.
4.Use sorter to sort data and check distinct in soter
properties.

Hope this will help you...

Jakka

Is This Answer Correct ?    2 Yes 0 No

Eliminating of duplicate records without using dynamic lookups..

Answer / kal_leo@hotmail.com

Hi U can eliminate duplicate records by an simple oneline
SQL Query.

select id, count(*) from seq1 group by id having
count(*)>1;

U can run this query directly on any SQL*Plus or U can
override SQL in any transformation.

Hope this is of any help.

Kal

Is This Answer Correct ?    2 Yes 1 No

Eliminating of duplicate records without using dynamic lookups..

Answer / vikram

To eliminate duplicate we use Source,Source qualifier,Look
up T/N, router T/N AND Target.. In This Case we use dynamic
cache


BUT USE
example emp table consist of i.d salary,name dept no.
eliminating the duplicates of dept no.

Source,Source Qualifier,Sorter T/N,Expression T/N,Router T/N
And split target in to two as duplicates and distinct
we have to create 3attributes in expression T/N AS
V_pre_deptno v_flag 0_flag
give condition as v_pre_dept no = dept no
v_flag= IFF(dept no = v_pre_deptno,1,0)

Is This Answer Correct ?    0 Yes 1 No

Post New Answer

More ETL Interview Questions

What is data cleaning?

0 Answers  


What do you understand by active and passive transformations?

0 Answers  


what are variable ports and list two situations when they can be used?

4 Answers   Satyam,


what is session partitioning?

0 Answers  


Hi please try to reply with answer. my mail id is raghu.1028@gmail.com. if the source is having millions of records, but having theree target tables. As per user the first record need to insert into first target and second record in to a second target and third into third target, similarly the process needs to repeat?

5 Answers  






can cubes contain measures ?

0 Answers  


Hi, I completed MCA in 2006.After studied Informatica,SQL server and basics of reporting tool in one of the training center in chennai.I got subject knowledge only.But I didn't go any job because I scared to face real time.Anyone please advice how can I enter again into this and anyone provide real time exposure with project.

0 Answers  


What are the different Lookup methods used in Informatica?

0 Answers  


can Informatica be used as a cleansing tool? If yes, give examples of transformations that can implement a data cleansing routine.

1 Answers  


In Which Transformation We Can Use Having Clause In Informatica?

0 Answers  


What exact we can see in table?

1 Answers  


Explain etl mapping sheets?

0 Answers  


Categories