i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?
Answer Posted / subhash
1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.
| Is This Answer Correct ? | 10 Yes | 0 No |
Post New Answer View All Answers
What is the different type of jobs in datastage?
How to perform incremental load in datastage?
What is staging variable?
describe the Steps to confiure a Qlogic switch
How many Key we can define in remove duplicate stage?
What is the Environment Variable need to Set to TRIM in Project Level?(In transfermer, we TRIM function but I need to impliment this project level using Environment variable)
Differentiate between hash file and sequential file?
Explaine the implimentation of scd's in ds indetail, please send me step by step procedure to perform scd's 1,2,3. Please replay for this, Thanks in advance
If you want to use the same piece of code in different jobs, how will you achieve it?
Can we use target hash file as a lookup ?
What is data partitioning?
what is the custome stage in datastage? how can we impliment that one? plz tell me
Name the third party tools that can be used in datastage?
What are system variables and sequencers in datastage
Explain entity, attribute and relationship in datastage?