Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...


How to read multiple files at different directories using a
single Sequential File stage in DS Enterprise Edition

Answers were Sorted based on User's Feedback



How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / subhash

If all files having same Metadata,

Select Read method as 'specific file(s)'
then u Can add as many files as you want to run by selecting 'file' property from the 'available properties to add'.
It locks like below:

File= /dsg/work/temp/Employee1.txt
File= /dsg/work/Employee2.txt
File= /dsg/Employee3.txt
Read Method= Specific file(s)

Is This Answer Correct ?    14 Yes 0 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / pvn

using file pattern

Is This Answer Correct ?    16 Yes 6 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / venkata ramana

To read given number of files, one can use follow below

In the sequential file stage, Use
Read Method =File Pattern
File Pattern=`ls /* | head -<Number of files to be read>`

For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`

Just modified Venkat's Answer based on tested job.

Is This Answer Correct ?    0 Yes 0 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / satyam

sequential file stage in that option is available you can observe that, ok i will send how to process later ok

Is This Answer Correct ?    4 Yes 5 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / pooja

To read multiple files in a sequential file follow the
below process..

1. Enable "Allow Multiple Instances" in the Job Properties.
2. Add a job parameter in the sequential file stage where
the input file needs to be defined.
3. Compile and execute the job.
4. During execution, a value needs to be passed to the job
parameter..here pass the input file path placed in
different directories.
5. Execute the job for all the multiple files using the
same job by passing the input file path for each run.
6. An invocation id needs to be provided for each run. This
id indicates the no. of times the job has been executed.
Can be observed in the log.

Is This Answer Correct ?    5 Yes 6 No

How to read multiple files at different directories using a single Sequential File stage in DS Ent..

Answer / venkat

To read given number of files, one can use follow below
steps:
1. In the sequential file stage, Use Read Method as
Specific File(s).
2. Now in the file text field, Put below command.
`ls /* | head -<Number of files to be read>`

This will read given number of files.

For example, I had 5 files, with similar pattern (as
date*.txt), in working folder say "/data/working/". If we
want to read three files out of these five files, one can
use following command:
`ls /data/working/date*.txt | head -3`

Hope this helps.


venkat
09940692102

Is This Answer Correct ?    0 Yes 7 No

Post New Answer

More Data Stage Interview Questions

1) In a dataset how to delete a single row? 2) i have 50 rows , i want to display 5-7 records only? How to write the sql query? 3)i have 40 rows,i want to display last row? write sql query?

7 Answers   Wipro,


How u implement the slowly changing dimensions if my source table is consisting of cid,cname,add,phno,email but i need to capture the changes for first three columns how u implement?

1 Answers   IBM,


What is the different type of jobs in datastage?

0 Answers  


hi iam new to this tooliam cmpltied to know abt datastage so now iam in project tell me whole step by step what iam doing iwnt to go with exp so plz hlp me pals

0 Answers  


What is the Main difference between Lookup Failure and Lookup Not Met? Plz explain with Example.

2 Answers  


which cache supports connected & un connected Lookup

1 Answers   Wipro,


how to clear the source file? 2) diff b/t odbc & Oracle?what is node? 3) explain one complex job u face in ur project

2 Answers   Wipro,


my soure table is emp having columns sal,deptno in the deptno 10,20,30deptno row are there expected out put is min(sal) of 10th deptno,max(sal) of 20th deptno,mean(sal) of 30th deptno using aggregation stage

4 Answers  


Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?

0 Answers  


Where the datastage stored his repository?

0 Answers  


SOURCE LIKE I_D,F1,F2 --------- 100,N,Y 100,N,N 100,Y,N 101,Y,Y 101,N,Y 102,Y,N 103,N,N 104,Y,Y 105,N,N 106,N,Y 102,N,Y 105,Y,Y O/P LIKE ID flag1 flag2 101 Y Y 101 N Y 102 Y N 102 N Y 104 Y Y 106 N Y

4 Answers  


explain how to create SCD-2 IN DATASTAGE 7.5X2 PLZ EXPLAIN WITH 4 OR 5 RECORDS TAKE IT EXAMPLE AND JOB DESINGN URGENT

3 Answers   IBM, Polaris,


Categories