How to read multiple files at different directories using a
single Sequential File stage in DS Enterprise Edition
Answer Posted / venkata ramana
To read given number of files, one can use follow below
In the sequential file stage, Use
Read Method =File Pattern
File Pattern=`ls /* | head -<Number of files to be read>`
For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`
Just modified Venkat's Answer based on tested job.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara
What is apt_config in datastage?
How do y read Sequential file from job control?
8000 jobs r there i given commit, suddenly job will abort? what happens? 2)diff b/t transformer stage & filter stage? 3)how to load the data in the source?
What are transforms and what is the differenece between routines and transforms?
Can you explain tagbatch restructure operator?
explain about completely flow of sequencers technicaly,without using example??explain about lookup,nullhandling?
How you Implemented SCD Type 1 & Type 2 in your project?
why do u need the IOS upgradation in a FC switch
What is the purpose of interprocessor stage in server jobs?
hi iam new to this tooliam cmpltied to know abt datastage so now iam in project tell me whole step by step what iam doing iwnt to go with exp so plz hlp me pals
Difference between IBM DATA STAGE8.5 and DATA STAGE9.1 ?
What is a merge?
Difference between data warehousing and olap?
what is repositery?