i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?
Answers were Sorted based on User's Feedback
1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.
| Is This Answer Correct ? | 10 Yes | 0 No |
Answer / krishna
1) In sequential stage we have stage properties on that
select options and increase the readers
2) In datastage admin we have on environmental variable like
logical reader that set as one
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / bharath
It can be achieved by DEGREE OF PARALLELISM.
i.e, we can configure the multiple nodes in the configuration
file. In configuration file we can specify multiple nodes..
| Is This Answer Correct ? | 2 Yes | 3 No |
Answer / prasad
In Seq file, we have one property called no. of readers/node(by default is one)=4 and
in Target table use "Bulk load" and also use Round Robin partition.
first drop index before loading data and once data loaded then re-create index again.
Plz correct me, if i am wrong.....
| Is This Answer Correct ? | 0 Yes | 1 No |
Hi All, I have a file. i need to fetch the records between first and last records by using transform stage. EX:- Source: EMPNO EMPNAME 4567 shree 6999 Ram 3265 Venkat 2655 Abhi 3665 Vamsi 5852 Amit 3256 Sagar 3265 Vishnu Target: EMPNO EMPNAME 6999 Ram 3265 Venkat 2655 Abhi 3665 Vamsi 5852 Amit 3256 Sagar I dont wan't to Shree and vishnu records.we can fetch another way also but How can I write the function in transform stage?
1)How will u implement SCD2 by using surrogate key. 2)What are the disadvantages with surrogate key. 3)How will you handle nulls in your project for the varchar, integer data types. 4)Can I use two fact tables in star schema. 5)3 jobs are running on the 2 nodes after I added one more node so can I compile those jobs to run on three nodes.
What steps should be taken to improve Datastage jobs?
Define Job control?
How do u view log file for a particular job?
Hi friends, I am new to datastage, i have one query in datastage any one you please give reply to my post. I have a workbook (excel sheet) named as eg: xxxx, in that i have two tables emp(eid, ename, salary, deptno) and dep(deptno, name, state). in my source i have ODBC enterprise stage read the emp table and dept table join the two table and write the dept no 10(eid,ename,salary,name,state) values in target(). Thanks, Badari
how to find out number of records imported into source file?
Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?
What is data partitioning?
what is flow of project?
how to retrive the max(sal),deptno,empno in datastage?
How can we run same job in 1 day 2 times