one file contains
col1
100
200
300
400
500
100
300
600
300
from this i want to retrive the only duplicate like this
tr1
100
100
300
300
300 how it's possible in datastage?can any one plz explain
clearley..........?
Answer Posted / reddymkl.dwh
Job Design:
Agg--->Filter1---------->|
| | Unique
file-->cp-------------------->Join---->Filter2---->target1
|
|-->Duplicate
Target2
Agg: use aggregator and select Agg_type=count rows and then give the Count O/P column=Cnt (User defined).
Filter1: give the condition Where=Cnt=1
U will get unique values like 200,400,500,600
Use Join (Or) Lookup stage: select left outer join
Filter2:
Where=Column_name='' (Duplicate values like 100,100,300,300,300)
Where=Column_name<>'' (Unique Values like 200,400,500,600)
u will get the right output....what ever the duplicate records.
Plz correct me if am wrong.....
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
What are transforms and what is the differenece between routines and transforms?
1.new record it will insert but changes of natural key is not present in taget i want to update (here key is composite natural key )can any one help this to explan how to do
Differentiate between validated and Compiled in the Datastage?
What are stage variables?
Describe the architecture of datastage?
How can we perform the 2nd time extraction of client database without accepting the data which is already loaded in first time extraction?
What is difference between server jobs & parallel jobs?
What is the difference between the local container and shared container?
What is Ad-Hoc access? What is the difference between Managed Query and Ad-Hoc access?
Define Routines and their types?
What are the enhancements made in datastage 7.5 compare with 7.0?
WAT TYPE OF PL/SQL QUERRYS USED IN DATASTAGE
What is orabulk stage?
How do u convert the columns to rows in datastage?
how to read 100 records at a time in source a) hw is it fr metadata Same and b) if metadata is nt same?