i want send my all duplicate record one tar and all uniq records one target ho

i want send my all duplicate record one tar and all uniq
records one target how we will perfome explain
example:
input data
eid
251
251
456
456
951
985
out put/target1
251
251
456
456
out put/target2
951
985
how we will bring

Question Posted / vsandu

13 Answers
16941 Views
Bank Of America, IBM, I also Faced
E-Mail Answers

Answers were Sorted based on User's Feedback

i want send my all duplicate record one tar and all uniq records one target how we will perfome ex..

Answer / anil

Hi,

This can be do easily with loops in transformer stage

Design
--------
Sq File - > Aggregrate - > Transformer - > Unique
|
Duplicate

1. In aggregate, calculate no of rows say counts
2. In transformer , define a stage variable stgTest whose derivation is if counts > 1 then 'Duplicate' Else 'Single'
3. In the loop condition define @iteration < Counts
4. Take a loop variable saying lopNumbers = EID
5. Now for Unique link write constraint as stgTest = 'Single' and output derivation of EID = @iteration.
6. Now for Duplicate link write constraint as stgTest = 'Duplicate' and output derivation of EID = @iteration.
7. Now you will get duplicate values in one link and unique values in another link.

Is This Answer Correct ?

0 Yes

1 No

i want send my all duplicate record one tar and all uniq records one target how we will perfome ex..

Answer / sreenu

Using aggregation and filter stage,
In aggregation stage we calculate the count of incoming
records and in filter we use count<>1 for output1, count=1 for
output2...

Is This Answer Correct ?

1 Yes

4 No

i want send my all duplicate record one tar and all uniq records one target how we will perfome ex..

Answer / vsandu

just sort the data ,and bring key changevalues by using
sort ,
in transformer write a logic if group id is 1,0 then target
1 else if group id is anly 1 then target2

as per my knowledge ,if any mistake correct me

Is This Answer Correct ?

1 Yes

6 No

Post New Answer