Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...


How to read multiple files at different directories using a
single Sequential File stage in DS Enterprise Edition

Answers were Sorted based on User's Feedback



How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / subhash

If all files having same Metadata,

Select Read method as 'specific file(s)'
then u Can add as many files as you want to run by selecting 'file' property from the 'available properties to add'.
It locks like below:

File= /dsg/work/temp/Employee1.txt
File= /dsg/work/Employee2.txt
File= /dsg/Employee3.txt
Read Method= Specific file(s)

Is This Answer Correct ?    14 Yes 0 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / pvn

using file pattern

Is This Answer Correct ?    16 Yes 6 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / venkata ramana

To read given number of files, one can use follow below

In the sequential file stage, Use
Read Method =File Pattern
File Pattern=`ls /* | head -<Number of files to be read>`

For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`

Just modified Venkat's Answer based on tested job.

Is This Answer Correct ?    0 Yes 0 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / satyam

sequential file stage in that option is available you can observe that, ok i will send how to process later ok

Is This Answer Correct ?    4 Yes 5 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / pooja

To read multiple files in a sequential file follow the
below process..

1. Enable "Allow Multiple Instances" in the Job Properties.
2. Add a job parameter in the sequential file stage where
the input file needs to be defined.
3. Compile and execute the job.
4. During execution, a value needs to be passed to the job
parameter..here pass the input file path placed in
different directories.
5. Execute the job for all the multiple files using the
same job by passing the input file path for each run.
6. An invocation id needs to be provided for each run. This
id indicates the no. of times the job has been executed.
Can be observed in the log.

Is This Answer Correct ?    5 Yes 6 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / venkat

To read given number of files, one can use follow below
steps:
1. In the sequential file stage, Use Read Method as
Specific File(s).
2. Now in the file text field, Put below command.
`ls /* | head -<Number of files to be read>`

This will read given number of files.

For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`

Hope this helps.


venkat
09940692102

Is This Answer Correct ?    0 Yes 7 No

Post New Answer

More Data Stage Interview Questions

Define Routines and their types?

0 Answers  


What are the primary usages of datastage tool?

0 Answers  


explain about citrix scheduling tool in datastage

0 Answers   HSBC,


at source level i have 40 columns,i want only 20 cols at target what r the various ways to get it

5 Answers   IBM,


source file contains 100 records, i want 10 records in target file how it possible in datastage

6 Answers   IBM,


1)What is ur project architecture ? 2)how to move project from developement to uat? 3)What is the difference between datastage 6,7.1 and datasttage 7.5? 4).How to do error handling in datastage? 5)3.Whta is unit testing, system testing and integration testing? 6)What is the Exact difference between BASIC Transformer and NORMAL Transformer?When we will go for BASIC Or NORMAL Transformer 7)why we use third party tools in datastage? 8)What is the purpose of Debugging stages? In real time Where we will use?

6 Answers   CTS, HCL, IBM, Wipro,


Source have 1000 records and it can have three nodes ok but i want how many records are executed on each node?

3 Answers   TCS,


i want anser this question empno,ename,sal 12,mmm_ww,200 13,nnn_xx,300 14,bbb_qq,400 which stages are take which types of logicks are doing pls help me i don't need "_"ex nnnxx this type i want

3 Answers  


In the source seq file have 2 columns, i.e input: col1,col2 1,1 2,rajesh 3,15000 4,2 5,suresh 6,16000 7,3 8,veeru 9,17000 I want in the output like: eno,ename,sal 1,rajesh,15000 2,suresh,16000 3,veeru,17000 any one answer this scenario

3 Answers  


how can we send even and odd records from a sequential file to two different targets

10 Answers   IBM, iGate, TCS,


i have input like this Column 1 ,column 2 3,a 4,b 5.c i want output  aaa bbbb ccccc Ple help any one?

4 Answers   SLK Software,


what is the unix script to run the job? Please mention commands which we use often?

3 Answers   TCS,


Categories