when will you go for dataset and fileset?
Answers were Sorted based on User's Feedback
Answer / jaimy chacko
just want to add something to the previous answer
Data sets are operating system files,
each referred to by a control file, which by
convention has the suffix .ds.
The control file points IBM InfoSphere DataStage
to a set of other files that carry the data.
The location of these data files is determined by the “resource disk” property in the configuration file used to run the job. Using data sets wisely can be key to good performance in a set of linked jobs.
You can also manage data sets independently of a job using the Data Set Management utility, available from
the IBM InfoSphere DataStage and QualityStage Designer or Director.
WebSphere DataStage can generate and name exported files, write them to their destination, and list the files it has generated in a file whose extension is,by convention,.fs.The data files and the file that lists them are called a file set.This capability is useful because some operating systems impose a 2 GB limit on the size of a file and you need to distribute files among nodes to prevent overruns. The amount of data that can be stored in each destination data file is limited by the characteristics of the file system and the amount of free disk space available.
| Is This Answer Correct ? | 8 Yes | 4 No |
Answer / jaimy chacko
Dataset and Fileset are almost the same .
Dataset is tool dependent and File Set is OS dependent(UNIX).
Dataset don't have any regulation of the amount of data that it has where as Fileset have limits to the data.
| Is This Answer Correct ? | 3 Yes | 5 No |
Unix Qn asked in datastage interview: I have diff type(.txt, .tmp, .bat etc) of file in 4 diff directories, I want move all '.txt' file from 4 directories to other folder. And need to delete all the files except which are created TODAY?
Source have 1000 records and it can have three nodes ok but i want how many records are executed on each node?
deptno wise to find max and min,and sum of rows and in target to company wise maximum
Describe stream connector?
Hi , Can anyone give few examples of scenarios and there corresponding design in datastage..i am new to this tool...confused in design while my manager asking to design the job.. Please post the URL if there..so i can go through it.. Thanks in advance...
what is the function in Transformer stage can act as Rank function in Oracle
I have scenario like this seq file --> transformer --> sort stage --> dataset In this job which prtitioning technique you are using and why???
what is factless fact table?
What is the difference between hashfile and sequential file?
how to convert rows into columns
how can u find out the datastage job is running on how many nodes
How do u convert the columns to rows in datastage?