Interested to Buy Any Domain ? << Click Here >> for more details...
How to read multiple files at different directories using a
single Sequential File stage in DS Enterprise Edition
- 6 Answers
- 26115 Views
- TCS, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
If all files having same Metadata,
Select Read method as 'specific file(s)'
then u Can add as many files as you want to run by selecting 'file' property from the 'available properties to add'.
It locks like below:
File= /dsg/work/temp/Employee1.txt
File= /dsg/work/Employee2.txt
File= /dsg/Employee3.txt
Read Method= Specific file(s)
| Is This Answer Correct ? | 14 Yes | 0 No |
Answer / venkata ramana
To read given number of files, one can use follow below
In the sequential file stage, Use
Read Method =File Pattern
File Pattern=`ls /* | head -<Number of files to be read>`
For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`
Just modified Venkat's Answer based on tested job.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / satyam
sequential file stage in that option is available you can observe that, ok i will send how to process later ok
| Is This Answer Correct ? | 4 Yes | 5 No |
Answer / pooja
To read multiple files in a sequential file follow the
below process..
1. Enable "Allow Multiple Instances" in the Job Properties.
2. Add a job parameter in the sequential file stage where
the input file needs to be defined.
3. Compile and execute the job.
4. During execution, a value needs to be passed to the job
parameter..here pass the input file path placed in
different directories.
5. Execute the job for all the multiple files using the
same job by passing the input file path for each run.
6. An invocation id needs to be provided for each run. This
id indicates the no. of times the job has been executed.
Can be observed in the log.
| Is This Answer Correct ? | 5 Yes | 6 No |
Answer / venkat
To read given number of files, one can use follow below
steps:
1. In the sequential file stage, Use Read Method as
Specific File(s).
2. Now in the file text field, Put below command.
`ls /* | head -<Number of files to be read>`
This will read given number of files.
For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`
Hope this helps.
venkat
09940692102
| Is This Answer Correct ? | 0 Yes | 7 No |
Hi guys, 7. how to get this output i/p col1,col2 101,a 102,b 103,c 104,d o/p col1,col2 101,d 102,c 103,b 104,a Thanks
Please Tell me..,I need some Complex Jobs in datastage as per in interview?how to tell and how to explain?please send as well as posiible please
How will you move hashed file from one location to another location?
Difference between ‘validated ok’ and ‘compiled’ in data stage?
How many types of stage?
Hi All , in PX Job I have passed 4 Parameters and when i run the same job in sequence i dont want to use those parameters , is this possible if yes then how
How did you reconcile source with target?
What are the benefits of datastage?
IN SEQUENTIAL FILE,I HAVE DATA LIKE THIS EID,ENAME 11,AA 11,CC 22,DD 33,EE 22,AA 22,BB 22,CC 11,BB THEN i SELECT perform sort ON eid,uncheck both unique,stable AND I CHOOSE hash SORTING.WHAT IS THE OUTPUT I CAN GET.what happend if i select UNIQUE,STABLE. PLEASE EXPLAIN HOW THE RECORDS DISPLAY AT TARGET.
Can we use Round Robin for aggregator?is there any benefit underlying?
how can we create a Sorrogate key in transformer stage? I want it in parallel mode
Explain the functionality of your current project?
1 Answers IBM, Miles Software,
Teradata 
