Eliminating of duplicate records without using dynamic lookups
Answers were Sorted based on User's Feedback
Answer / jakka
Below are the ways to eliminate the duplicate records:
1.Select distinct in source qualifier
2.Based on your requirement,select and give number of
sorted ports in source qualifier and need to override the
query using order by cluase. Then use aggregator and select
sorted input as given and use group by ports
3. Use sorter to sort data and then use aggregator as
mentined in point 2.
4.Use sorter to sort data and check distinct in soter
properties.
Hope this will help you...
Jakka
| Is This Answer Correct ? | 2 Yes | 0 No |
Answer / kal_leo@hotmail.com
Hi U can eliminate duplicate records by an simple oneline
SQL Query.
select id, count(*) from seq1 group by id having
count(*)>1;
U can run this query directly on any SQL*Plus or U can
override SQL in any transformation.
Hope this is of any help.
Kal
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / vikram
To eliminate duplicate we use Source,Source qualifier,Look
up T/N, router T/N AND Target.. In This Case we use dynamic
cache
BUT USE
example emp table consist of i.d salary,name dept no.
eliminating the duplicates of dept no.
Source,Source Qualifier,Sorter T/N,Expression T/N,Router T/N
And split target in to two as duplicates and distinct
we have to create 3attributes in expression T/N AS
V_pre_deptno v_flag 0_flag
give condition as v_pre_dept no = dept no
v_flag= IFF(dept no = v_pre_deptno,1,0)
| Is This Answer Correct ? | 0 Yes | 1 No |
What is Data Vault???
Explain the use lookup tables and Aggregate tables?
where is the cache (lookup, index) created and how can you see it.
Explain about round-robi?
I have a Flat file with more no. of Records also including duplicate values. But i need distinct values to one target and remaining records to another target in Informatica way
Identifying the bottlenecks in various components of Informatica and resolving them.
How can we handle Rejection Logic in Source tables while we are matching the data in Target side in ETL Testing ?
Is apache nifi an etl tool?
what are the types in error loging?
What is a mapping, session, worklet, workflow, mapplet?
What is a materialized view log?
what is session partitioning?