source
1123445
I WANT OUTPUT AS
DUPLICATES TO TARGET1 LIKE
TARGET1
1144
NON-DUPLICATES TO TARGET2
TARGET2
235
Answers were Sorted based on User's Feedback
Source
..|
..|
copy--->agg
..|.....|
..|.....|
join stage
....|
....|
Filter stage -----> target1
..|
..|
target2
the main data is:
1
1
2
3
4
4
5
from aggregator stage, the output is:
1,2
2,1
3,1
4,2
5,1
If you join these two links then the output will be:
1,2
1,2
2,1
3,1
4,2
4,2
5,1
Then specify the count<>1 in the Filter for target1 then you get the duplicate records. means YOU get:
1
1
4
4
in another link for target2, give count=1. means YOU get:
2
3
5
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / s
agg-->filter-->trg2
^ |
| v
seq-->copy-->join-->trg1
agg:countrows
join:innerjoin
filter:count=1
:count>1
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / chaint
source1(112345) ----- lookup stage- reference lookup
on(source2 output)--reject link(1144) --output(235)
source2(112345) -- sort( get count) -> filter(only unique)
we would require two source..
one original and other only (non repeated records)
we will have a lookup stage with source1 as input and
source2 as reference lookup..
in lookup stage we will have a reject link(1144) non matched
records.. and output will be(235).
Kindly correct me if i m wrong
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / nagam
seq.file----->sort------>filter----2datasets
in sort stge create key change column and then filter stage
write the condition on based on keychange column keychange
column =1 uniq data keychange<>0 duplicate data we can get
If wrong please tell me
| Is This Answer Correct ? | 0 Yes | 5 No |
what is the main differences between Lookup, Join and Merge stages?
What is the version control how can i apply this in DataStage can any one tell me the anser
What are stage variables, derivations and constants?
To see hidden files in LINIX?
What is the precedence of stage variables,derivations, and constraints?
how to transfer file from one system to another system in unix? which cmd to be use?
How many Nodes configuration file you used in your last project?
What is difference between join, merge and lookup stage?
what is a message handler
Where do the datastage jobs get stored?
What is a range lookup?
What is the difference between informatica and datastage?