source
1123445
I WANT OUTPUT AS
DUPLICATES TO TARGET1 LIKE
TARGET1
1144
NON-DUPLICATES TO TARGET2
TARGET2
235
Answers were Sorted based on User's Feedback
Source
..|
..|
copy--->agg
..|.....|
..|.....|
join stage
....|
....|
Filter stage -----> target1
..|
..|
target2
the main data is:
1
1
2
3
4
4
5
from aggregator stage, the output is:
1,2
2,1
3,1
4,2
5,1
If you join these two links then the output will be:
1,2
1,2
2,1
3,1
4,2
4,2
5,1
Then specify the count<>1 in the Filter for target1 then you get the duplicate records. means YOU get:
1
1
4
4
in another link for target2, give count=1. means YOU get:
2
3
5
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / s
agg-->filter-->trg2
^ |
| v
seq-->copy-->join-->trg1
agg:countrows
join:innerjoin
filter:count=1
:count>1
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / chaint
source1(112345) ----- lookup stage- reference lookup
on(source2 output)--reject link(1144) --output(235)
source2(112345) -- sort( get count) -> filter(only unique)
we would require two source..
one original and other only (non repeated records)
we will have a lookup stage with source1 as input and
source2 as reference lookup..
in lookup stage we will have a reject link(1144) non matched
records.. and output will be(235).
Kindly correct me if i m wrong
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / nagam
seq.file----->sort------>filter----2datasets
in sort stge create key change column and then filter stage
write the condition on based on keychange column keychange
column =1 uniq data keychange<>0 duplicate data we can get
If wrong please tell me
| Is This Answer Correct ? | 0 Yes | 5 No |
i have a scenario with i/p as ID,salary with values 1,1000 2,2000 and 3,4000 i need an extra column in the o/p named amount with values 2000,4000 and NULL. how can i get it?
i have a project manager round on sat this week can you post what are the main question i have to check.if you have any idea regular question on project pls send me. thanks in advance
What are the various kinds of containers available in datastage?
Converting Vertical PIVOTing without using PIVOT stage in DataStage. Ex: DEPT_NO EMPNAME 10 Subhash 10 Suresh 10 sravs Output: DEPT_NO EMP1 EMP2 EMP3 10 subhash suresh sravs 2) How to implement Horizontal PIVOTing without using PIVOT stage.
What's the Main Function of the Staging area in DWH
what about data stage requirement
whats relation between configuration file and datasets?
explain how to create SCD-2 IN DATASTAGE 7.5X2 PLZ EXPLAIN WITH 4 OR 5 RECORDS TAKE IT EXAMPLE AND JOB DESINGN URGENT
what is use of SDR function?
Hi guys, please design job for this, MY INPUT IS COMPANY,LOCATION IBM,CHENNAI IBM,HYDRABAD IBM,PUNE IBM,BANGLOORE TCS,CHENNAI TCS,MUMBAI TCS,BANGLOORE WIPRO,HYDRABAD WIPRO,CHENNAI HSBC,PUNE MY OUTPUT IS COMPANY,LOCATION,COUNT IBM,chennai,hydrabad,pune,banglore,4 TCS,chennai,mumbai,bangloore,3 WIPRO,hydrabad,chennai,2 HSBC,pune,1 Thanks
how can u find out the datastage job is running on how many nodes
What is the difference between odbc and drs stage?