hi All,
i have one scenario like if
source--->transformer-->2 target sequential files
the 1 st target sequential file is loads the data from
source
and 2nd target sequntial file contain the 1st target total
record count,and file name of 1 st target seq file and
timestamp seperated by delimeter
for example if source have 10 record the 1st target seq
file hav 10 records
and
2nd target seq file example
10|xyz.txt|20101110 00:00:00
could you please help me out how can i implement in
datastage job.
Answers were Sorted based on User's Feedback
Hi,
in derivation for seq2 give as follows,
for file name give job parameter as file name and datatype is char..
for timestamp give Current CurrentTimestamp()
for count rows it is not not possible by using transformer
it can be achieved by adding another stage
that is aggregation stage..
| Is This Answer Correct ? | 8 Yes | 2 No |
Answer / ankita, cgi
Hi,
I have tried to get this output, i got the idea upto some
extent,
Could you please Elaborate your solution? how to get this
exact output, i.e., (10|xyz.txt|20101110 00:00:00), except
count.
Thanks in Advance.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / kirill lychagin
I managed to make such job in IIS 8.5, but i think it can be reproduced in all 8.* versions/
Main question is how to get rows count in transformer. In general it can't be done. But we have sequential file stage as target.
So my solution:
1) name of 1st target file is job parameter.
2) on link to 2nd target file we add to columns:
FNAME=#FIRSTTARGETFILE# - name of 1st target file
ROW_NUM=@INROWNUM - number of input row
3) on input link to 2snd sequntial file set Collector Type=Ordered and set ROW_NUM as sort key column
4) Then in 2nd Sequntial File Stage at tab Properties add "Filter" in Options category and write there "head -n 1"
Profit!
SO the idea is to get column num in transformer and apply unix style filter (mks on Windows) on output to Seq File.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / akila
Pass the name of the file in a parameter, say p1.If your
count of rows flowing through the transformer is not huge,
the run the transformer in sequential stage and pass
@INROWNUM:'|':p1:'|':DSJobStartTimeStamp as a value of a
field. Add a tail stage in between the transformer and the
2nd file. In the tail stage, input 1 as the count of
records.
| Is This Answer Correct ? | 0 Yes | 0 No |
Instead of using shared container in a job, I use jobs which perform similar function as Container in the sequence. Then what is the need of Shared Container?
1.which index is follows the dimensions tables?why? 2.what is the use of trigger in job sequence? 3.what is the mean of optimization? 4.what is the job control?when we use it? what is difference bet batch and sequencer? 6.seq--->seq,seq--->copy--->seq which one is best and efficient?
Hai..,in datastage how to explain project in interview?please explain any domain please.
Triggers,VIEW,Procedures
how to call routines in stages?
What are the various kinds of the hash file?
What a datastage macro?
I have Seq file, I don't want 10, 11th(or any two records like 20, 30th records ) records in the output
Different ways a project can be moved to production ?...example ….export-import and Version control.
how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara
How do you start developing a datastage project?
Which commands are used to import and export the datastage jobs?