I have a scenario like
Deptno=10---->First record and last record
Deptno=20---->First record and last record
Deptno=30---->First record and last record
I want those first and last records from each department in
a single target. How to do this in DataStage, any one can
assist me.
Thanks in advance.
Answers were Sorted based on User's Feedback
Answer / ashok
Source--->Sort stage--->copy stage
From copy stage we have to take two source stages
(source1,source2)
source1-->Removeduplicate stage(in this we can get first
record from each dept)
source2--->Remove duplicate stage(in this we can get last
record from each dept)
using funnel we can add these results.
| Is This Answer Correct ? | 10 Yes | 4 No |
Answer / d anil babu
take source--->copy---->remove dupli stage---->
----->remove dupli stgae-->funnel-->dataset
in first remove duplicate stage select duplicate retain first
in second rmd select duplicate retain last and in funnel u
have to select the sort funnel
| Is This Answer Correct ? | 3 Yes | 1 No |
Answer / amjad pasha
SOURCE ---> SORT STAGE(sort key mode = sort, create cluster
key change column and create key change column should be
false) ---> COPY STAGE ---> (2 REMOVE DUPLICATE STAGES)
REMOVE DUPLICATE STAGE_1 (key=dept and Duplicate to Retain
= First) AND REMOVE DUPLICATE STAGE_2 (key=dept and
Duplicate to Retain = Last) ---> FUNNEL STAGE (Funnel
Type=Continues Funnel) ---> TARGET
| Is This Answer Correct ? | 2 Yes | 0 No |
Answer / prabhu
source->sortstage->removeduplications->dataset
in sortstage->create key changecolumn=true
after
removeduplicates stage->duplicates retain:-last
we can get last and first record group wise.
| Is This Answer Correct ? | 4 Yes | 2 No |
1.
Source--->Sort stage--->copy stage======>(SRC1,SRC2)
From copy stage we have to take two source stages
(SRC1,SRC2)
SRC-->Removeduplicate stage(in this we can get first
record from each dept--> Duplicates To Retain=First)
SRC2--->Remove duplicate stage(in this we can get last
record from each dept--> Duplicates To Retain=Last)
using funnel we can add these results.
2.
source->sortstage->removeduplications->dataset
in sortstage->create key changecolumn=true
this will set '1' for 1st records and '0' next duplicate
records.
after
removeduplicates stage(key columns=Deptno, CreateKeyChange
Columns)->duplicates retain:-last
we can get last(CreateKeyChange is zero and from all the
duplicates in that group, we are retaing last record) and
first(CreateKeyChange is 1) record group(Dept) wise.
| Is This Answer Correct ? | 2 Yes | 0 No |
Answer / naga
take a sequential file and give the output link to copy
stage and from copy stage give one output link to head
stage and one output to tail stage and in head and tail
stages give no. of partitions per record =1 and give the
output to funnel stage and give funnel type = sequence and
mention the link order to displays which records first and
give the output link to dataset and you will get the output
you want
| Is This Answer Correct ? | 4 Yes | 3 No |
Answer / c raghavendra nivas
-------removeduplicate(first)
source---copy ------funnel----output
-------removeduplicate(last)
it works i did it
try if u want
if its a database you can do witha co-related sub query
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / naga
take sequential file and give its output to copy and copy
it to two datasets.in one dataset select the partition on
deptno type=modulus and perform sort and select both stable
and unique you will get first redcords and in another
dataset select partition on deptno and type modulus and
perform sort and select only unique and give give both
dataset outputs to funnel and give its output to dataset
| Is This Answer Correct ? | 1 Yes | 3 No |
What is active and passive stage?
if we using two sources having same meta data and how to check the data in two sources is same or not? and if the data is not same i want to abort the job ?how we can do this?
can we see the data in fixed width file? how can u change the datatype of fixed width files?
how to cleansing data
Give example for FACTLESS FACT TABLE in real-time scenario.
while we using change capture stage we have to be take two table thats are 1.before table 2. after table . what is before table and after table please give me clear notation Thank You very much in advance
i have a job with 3 possibiliies finish with ststus ok abbort warning how do you handle these 3 in job sequence? explain the situation where you have appiled scd in your project? chandu
What is the difference between in process and inter process?
data stores in which location while using data set stage as the target?
how can u connect the client system directly at any time?
which dim, fact tables used in bank domain
what are the different type of errors in datastage?