How to delete duplicate record in Informatica?
Answers were Sorted based on User's Feedback
Answer / suresh
if the source is database means we can delete the duplicate
records by enabling the option select distinct in source
qualifier t/r properties or by writing the following query
in source qualifier filter
delete from emp where rowid not in (select min(rowid) from
emp group by empno);
if the source is flat file means by enabling the option
distinct in sorter t/r we can delete the duplicate records
| Is This Answer Correct ? | 27 Yes | 1 No |
Answer / mayuri
Select ditinct in properties of source qualifier
transformation.
| Is This Answer Correct ? | 21 Yes | 6 No |
Answer / infa dev
Source and the target will the same table from which the
duplicate needs to be deleted from. Then use a lookup trans
on to this same table and then use an update trans with
DD_DELETE if the row is duplicate else do nothing.
| Is This Answer Correct ? | 12 Yes | 3 No |
Answer / julius caeser
Hi
There are 2 ways to do this and both of them are efficient.
Method 1: Sorter -Filter.
Send all the data to a sorter and , sort by all feilds that
u want to remove duplicacy from . note that in the
preoperties tab, select Unique .
This will select and send forward only Unique Data .
Method 2; Use an Aggregator
Use AGG Transformation and group by the keys /feilds that u
want to remove duplicacy from.
| Is This Answer Correct ? | 11 Yes | 3 No |
Answer / aswin
use aggregator and do not apply any aggregation function, it will return only last row in the group..if you dont provide any groupby and aggregate value it will return only last row..so you can aviod dups
| Is This Answer Correct ? | 0 Yes | 1 No |
Answer / mayuresh
Hi,
how to delete duplicate values from table if source and
target are same
my Question is which logic we need to apply before using
DD_DELETE option in update strategy ?
Do we require to use aggregator to group the values and if
there count > 1 then DD_DELETE
PLZ reply
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / sarvesh
create table newtable as select distinct * from original
tablename;
by doing this we can elimate the duplicate rows
| Is This Answer Correct ? | 6 Yes | 10 No |
we r using aggregator with out using groupby?
7 Answers HSBC, Principal Finance,
How do schedule a workflow in Informatica thrice in a day? Like run the workflow at 3am, 5am and 4pm?
IF Sorce table contains CLOB as its one data type then i get error at the target table. How can this be resolve?
How many ways are there to create ports?
I have Employee table, 10 cols are connected to next transformation, only 4 cols are selected in SQL override. What would be passed to next col.
write a query for how to eliminate the duplicate rows without using distinct?
scenario
Hi Experts, I have a source table like this. Name Number Raj 2 Ram 1 Sam 2 John 1 In the target I need the ouptput like the below Raj Raj Ram Sam Sam John We dont know the number value . It will be changing as n.. Please help me regarding this. Thanks, Nataraj V
Plz can any one say me how to get the informatica certification materials and dumps
Hi, I want to change date type char value integer value? I tried alter table tab_name modify (newcolumn newdatetype). But The columns have 10 million values(char type) so I want to load now numeric data. How it is possible? Old Values New Value(I want to load numeric data but the old value should be there in the column) Y 1 N 0 ERROR at line 1: ORA-01439: column to be modified must be empty to change datatype Please help on this. Thanks, GM
 Suppose you have n no.of records @ your flat file and you have seen some of records are missing while reaching to the destination. How can you trouble shoot it?
WHAT IS EDM?WHAT IS THE USE IN INFORMATICA? chandumba2005@gmai.com