hi All,
i have one scenario like if
source--->transformer-->2 target sequential files
the 1 st target sequential file is loads the data from
source
and 2nd target sequntial file contain the 1st target total
record count,and file name of 1 st target seq file and
timestamp seperated by delimeter
for example if source have 10 record the 1st target seq
file hav 10 records
and
2nd target seq file example
10|xyz.txt|20101110 00:00:00
could you please help me out how can i implement in
datastage job.
Answer Posted / kirill lychagin
I managed to make such job in IIS 8.5, but i think it can be reproduced in all 8.* versions/
Main question is how to get rows count in transformer. In general it can't be done. But we have sequential file stage as target.
So my solution:
1) name of 1st target file is job parameter.
2) on link to 2nd target file we add to columns:
FNAME=#FIRSTTARGETFILE# - name of 1st target file
ROW_NUM=@INROWNUM - number of input row
3) on input link to 2snd sequntial file set Collector Type=Ordered and set ROW_NUM as sort key column
4) Then in 2nd Sequntial File Stage at tab Properties add "Filter" in Options category and write there "head -n 1"
Profit!
SO the idea is to get column num in transformer and apply unix style filter (mks on Windows) on output to Seq File.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
how to implement scd2 in datastage 7.5 with lookup stage
Can you highlight the main features of ibm infosphere information server?
Nls stands for what in datastage?
What are transforms and what is the differenece between routines and transforms?
What is oci?
sed,awk,head
What are data elements?
Explain the datastage parallel extender (px) or enterprise edition (ee)?
How a source file is populated?
what is the use of materialized view?
What are the difference types of stages?
What is the difference between validated and compiled in the datastage?
If you want to use a same piece of code in different jobs, how will you achieve this?
whom do you report?
Define Data Stage?