hi All,
i have one scenario like if
source--->transformer-->2 target sequential files
the 1 st target sequential file is loads the data from
source
and 2nd target sequntial file contain the 1st target total
record count,and file name of 1 st target seq file and
timestamp seperated by delimeter
for example if source have 10 record the 1st target seq
file hav 10 records
and
2nd target seq file example
10|xyz.txt|20101110 00:00:00
could you please help me out how can i implement in
datastage job.
Answers were Sorted based on User's Feedback
Hi,
in derivation for seq2 give as follows,
for file name give job parameter as file name and datatype is char..
for timestamp give Current CurrentTimestamp()
for count rows it is not not possible by using transformer
it can be achieved by adding another stage
that is aggregation stage..
| Is This Answer Correct ? | 8 Yes | 2 No |
Answer / ankita, cgi
Hi,
I have tried to get this output, i got the idea upto some
extent,
Could you please Elaborate your solution? how to get this
exact output, i.e., (10|xyz.txt|20101110 00:00:00), except
count.
Thanks in Advance.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / kirill lychagin
I managed to make such job in IIS 8.5, but i think it can be reproduced in all 8.* versions/
Main question is how to get rows count in transformer. In general it can't be done. But we have sequential file stage as target.
So my solution:
1) name of 1st target file is job parameter.
2) on link to 2nd target file we add to columns:
FNAME=#FIRSTTARGETFILE# - name of 1st target file
ROW_NUM=@INROWNUM - number of input row
3) on input link to 2snd sequntial file set Collector Type=Ordered and set ROW_NUM as sort key column
4) Then in 2nd Sequntial File Stage at tab Properties add "Filter" in Options category and write there "head -n 1"
Profit!
SO the idea is to get column num in transformer and apply unix style filter (mks on Windows) on output to Seq File.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / akila
Pass the name of the file in a parameter, say p1.If your
count of rows flowing through the transformer is not huge,
the run the transformer in sequential stage and pass
@INROWNUM:'|':p1:'|':DSJobStartTimeStamp as a value of a
field. Add a tail stage in between the transformer and the
2nd file. In the tail stage, input 1 as the count of
records.
| Is This Answer Correct ? | 0 Yes | 0 No |
Enlist various types of routines in datastage.
In work load management there are three options of Low priority, Medium priority and High Priority Jobs which can be used for resource management. why this feature is developed when there is already jobs prescheduled by scheduler or autosys. what will be the use of workload management then?
Hi friends If anybody completed datastage 8.5 certification.Could please guide me what are the topics new in 8.5 certification.
i want job aborted after some records are loaded into output by using only sequential stage and dataset
What modeling tool do you use?
What is the surrogate key? what is the use of surrogate key? how to Create surrogate key Generator in scd2 in 8.5?
What is usage analysis in datastage?
explain how to create SCD-2 IN DATASTAGE 7.5X2 PLZ EXPLAIN WITH 4 OR 5 RECORDS TAKE IT EXAMPLE AND JOB DESINGN URGENT
hi i am madan, in real time data stage who is the source provide? and how to recevied in developer? Pls send me answer
What are stage variables, derivations and constants?
convert yyyy mm dd to dd mm yyyy?
CHANGE CAPTURE