Using Expression transformation how to remove duplicate records from a relatio

Using Expression transformation how to remove duplicate
records from a relational source?

Question Posted / jey.dgl

4 Answers
23248 Views
I also Faced
E-Mail Answers

Answers were Sorted based on User's Feedback

Using Expression transformation how to remove duplicate records from a relational source?..

Answer / prathibha

Hi,

Source->SQ->Sorter->Expression->FilterTarget.
Lets take a small example for this scenario.
Use a sorter to sort the input data.
ID Name
1 A
1 A
2 B
3 C
3 C

In Expression Transformation declare the following ports:

ID
Name
O_Count= iiF(V_port=ID,O_Count=O_count+1,O_Count=0)
V_port(Variable Port) = ID;

In filter transformation give the condition O_Count =0;
Let me know if there are any suggestions.

Is This Answer Correct ?

17 Yes

2 No

Using Expression transformation how to remove duplicate records from a relational source?..

Answer / infabee

Expression is a passive transformation. So we can't delete
any row in it. We can achive only by using an active
transformation with/without it (SQ,Filter,Agg..etc).

Is This Answer Correct ?

4 Yes

1 No

Using Expression transformation how to remove duplicate records from a relational source?..

Answer / babu

Hi,

SRC-->SQ(ENABLE DISTINCT )-->EXP-->TRG

OR
IN EXP T/R TAKE 4 VARIABLE PORTS AND OUTPUT PORT,
SRC HAVEING THE COLUMNS LIKE COL1,COL2,COL3
SRC-->SQ-->SRT(PLEASE TAKE ALL ARE KEY PORTS)-->EXP
(VAR IS IIF(VAR1=COL1 AND VAR2=COL2 AND
VAR3=COL3),1,0)
VAR1=COL1
VAR2=COL2
VAR3=COL3
OUT=VAR
-->UPD(IIF(OUT=1,DD_REJECT,DD_INSERT))-->TRG

IF ANY THING WRONG PLEASE LET ME KNOW.
8861145051

Is This Answer Correct ?

6 Yes

9 No

Using Expression transformation how to remove duplicate records from a relational source?..

Answer / bijay

The mapping should be like this
SRC->SQ->EXP->TARGET
In source qualifier transformation select 'ENABLE DISTINCT',
then it will send only distinct record to the expression transformtion. And From expression transformation simply connect to the target

Is This Answer Correct ?

2 Yes

5 No

Post New Answer