source
1123445
I WANT OUTPUT AS
DUPLICATES TO TARGET1 LIKE
TARGET1
1144
NON-DUPLICATES TO TARGET2
TARGET2
235
Answers were Sorted based on User's Feedback
Source
..|
..|
copy--->agg
..|.....|
..|.....|
join stage
....|
....|
Filter stage -----> target1
..|
..|
target2
the main data is:
1
1
2
3
4
4
5
from aggregator stage, the output is:
1,2
2,1
3,1
4,2
5,1
If you join these two links then the output will be:
1,2
1,2
2,1
3,1
4,2
4,2
5,1
Then specify the count<>1 in the Filter for target1 then you get the duplicate records. means YOU get:
1
1
4
4
in another link for target2, give count=1. means YOU get:
2
3
5
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / s
agg-->filter-->trg2
^ |
| v
seq-->copy-->join-->trg1
agg:countrows
join:innerjoin
filter:count=1
:count>1
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / chaint
source1(112345) ----- lookup stage- reference lookup
on(source2 output)--reject link(1144) --output(235)
source2(112345) -- sort( get count) -> filter(only unique)
we would require two source..
one original and other only (non repeated records)
we will have a lookup stage with source1 as input and
source2 as reference lookup..
in lookup stage we will have a reject link(1144) non matched
records.. and output will be(235).
Kindly correct me if i m wrong
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / nagam
seq.file----->sort------>filter----2datasets
in sort stge create key change column and then filter stage
write the condition on based on keychange column keychange
column =1 uniq data keychange<>0 duplicate data we can get
If wrong please tell me
| Is This Answer Correct ? | 0 Yes | 5 No |
what is the unix script to run the job? Please mention commands which we use often?
what is combinability and non combinability?
What is the importance of the exception activity in datastage?
What is the use of hoursfromtime() function in transformer stage in datastage?
how to capture rejected data by using join stage not for lookup stage. please let me know
create a job to get the previous row salary for the current row.if there is no previous row exists for the current row,then the previous row salary should be displayed as null? empid salary previoussalary 10 1000 null 20 2000 1000 30 3000 2000 40 4000 3000
what is a force compile
1.What is a delta record? How you will read it? 2.What are the different types of sorting?
i have a some records eno ename acono amount 1001 suresh sbi101 12000 1001 suresh sbi101 14000 1001 is dublicata how can i remove duplicate?
Please Tell me..,I need some Complex Jobs in datastage as per in interview?how to tell and how to explain?please send as well as posiible please
what are the errors,warnings in datastage
Hi Friends, I have a input data like, class_id Marks 101 50 101 60 101 40 102 90 102 35 And i want my output data like class_id Marks Rank 101 50 2 101 60 1 101 40 3 102 90 1 102 35 2 how to do this in datastage?
8 Answers Cognizant, HCL, TIAA CREF,