hi All,
i have one scenario like if
source--->transformer-->2 target sequential files
the 1 st target sequential file is loads the data from
source
and 2nd target sequntial file contain the 1st target total
record count,and file name of 1 st target seq file and
timestamp seperated by delimeter
for example if source have 10 record the 1st target seq
file hav 10 records
and
2nd target seq file example
10|xyz.txt|20101110 00:00:00
could you please help me out how can i implement in
datastage job.
- 4 Answers
- 11657 Views
- IBM, I also Faced
- E-Mail Answers
Answer Posted / kirill lychagin
I managed to make such job in IIS 8.5, but i think it can be reproduced in all 8.* versions/
Main question is how to get rows count in transformer. In general it can't be done. But we have sequential file stage as target.
So my solution:
1) name of 1st target file is job parameter.
2) on link to 2nd target file we add to columns:
FNAME=#FIRSTTARGETFILE# - name of 1st target file
ROW_NUM=@INROWNUM - number of input row
3) on input link to 2snd sequntial file set Collector Type=Ordered and set ROW_NUM as sort key column
4) Then in 2nd Sequntial File Stage at tab Properties add "Filter" in Options category and write there "head -n 1"
Profit!
SO the idea is to get column num in transformer and apply unix style filter (mks on Windows) on output to Seq File.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
What are the different kinds of views available in a datastage director?
Explain entity, attribute and relationship in datastage?
What are the areas of application?
What is size of a transaction and an array means in a datastage?
How do you remove duplicate values in datastage?
What is data partitioning?
8000 jobs r there i given commit, suddenly job will abort? what happens? 2)diff b/t transformer stage & filter stage? 3)how to load the data in the source?
How to read multiple files using a single datastage job if files have the same metadata?
Can you implement SCD2 using join, transformer and funnel stage?
What are stage variables, derivations and constants?
Describe link sort?
Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?
What is developer responsibilities in UAT (user acceptance testing and Post implementation phase?
What steps should be taken to improve Datastage jobs?
how to implement scd2 in datastage 7.5 with lookup stage
