hi All,
i have one scenario like if
source--->transformer-->2 target sequential files
the 1 st target sequential file is loads the data from
source
and 2nd target sequntial file contain the 1st target total
record count,and file name of 1 st target seq file and
timestamp seperated by delimeter
for example if source have 10 record the 1st target seq
file hav 10 records
and
2nd target seq file example
10|xyz.txt|20101110 00:00:00
could you please help me out how can i implement in
datastage job.
Answer Posted / kirill lychagin
I managed to make such job in IIS 8.5, but i think it can be reproduced in all 8.* versions/
Main question is how to get rows count in transformer. In general it can't be done. But we have sequential file stage as target.
So my solution:
1) name of 1st target file is job parameter.
2) on link to 2nd target file we add to columns:
FNAME=#FIRSTTARGETFILE# - name of 1st target file
ROW_NUM=@INROWNUM - number of input row
3) on input link to 2snd sequntial file set Collector Type=Ordered and set ROW_NUM as sort key column
4) Then in 2nd Sequntial File Stage at tab Properties add "Filter" in Options category and write there "head -n 1"
Profit!
SO the idea is to get column num in transformer and apply unix style filter (mks on Windows) on output to Seq File.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
How do you generate sequence number in datastage?
Define project in datastage?
How do you run datastage job from the command line?
Why we use surrogate key?
What are the different plug-ins stages used in your projects?
What are the processing stages?
how to run a sequential file stage in parallel if the stage is used on the TARGET side
explain about citrix scheduling tool in datastage
Which warehouse using in your datawarehouse
Explain the importance of surrogate key in data warehousing?
Describe routines in datastage? Enlist various types of routines.
How can we perform the 2nd time extraction of client database without accepting the data which is already loaded in first time extraction?
Define orabulk and bcp stages?
What are constraints and derivations?
disign the complex job in u r project?(they are aksing only complex job design and then data flow...)