i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?
Answers were Sorted based on User's Feedback
1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.
Is This Answer Correct ? | 10 Yes | 0 No |
Answer / krishna
1) In sequential stage we have stage properties on that
select options and increase the readers
2) In datastage admin we have on environmental variable like
logical reader that set as one
Is This Answer Correct ? | 2 Yes | 1 No |
Answer / bharath
It can be achieved by DEGREE OF PARALLELISM.
i.e, we can configure the multiple nodes in the configuration
file. In configuration file we can specify multiple nodes..
Is This Answer Correct ? | 2 Yes | 3 No |
Answer / prasad
In Seq file, we have one property called no. of readers/node(by default is one)=4 and
in Target table use "Bulk load" and also use Round Robin partition.
first drop index before loading data and once data loaded then re-create index again.
Plz correct me, if i am wrong.....
Is This Answer Correct ? | 0 Yes | 1 No |
my source seq file have col1 1 2 3 4 5 6 7 8 9 i have 4 targets t1 t2 t3 t4 1 2 3 4 5 6 7 8 9 like this how we can get?
what are the different type of errors in datastage?
Which commands are used to import and export the datastage jobs?
Explain the datastage parallel extender (px) or enterprise edition (ee)?
HOW CAN YOU DO SCD2 IN DATA STAGE USING SEQUENTIAL FILES?
Describe the main features of datastage?
how to get the unique records on multiple columns by using sequential file stage only
I have the following columns in the EMP table Empid,Empname,Sal,month(Sal),year(Sal) and DOB(let us say the dob is 15th-Jan-1981) Desing a job such that the output contains the following empname,year(sal),tot(sal) and current age i.e. whether 18yrs or so on
Describe link sort?
What is container and then types?
Hi I have scenario like this s/r table T/r table ename,sal empno,ename,sal vijay,2000 1 , vijay, 2000 kumar,3000 2 ,kumar , 3000 ravi ,4000 3 ,ravi , 4000 How can i get target table like that without using Transformer stage?
How can we select pr retrieve the particular row in dataset by using orchadmin command?