i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?
- 5 Answers
- 13175 Views
- TCS, I also Faced
- E-Mail Answers
Answer Posted / subhash
1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.
| Is This Answer Correct ? | 10 Yes | 0 No |
Post New Answer View All Answers
options available in sequence job to run,validate?
What is quality stage?
What is Ad-Hoc access? What is the difference between Managed Query and Ad-Hoc access?
Notification Activity
What are the different options associated with dsjob command?
How can we improve performance of data stage jobs?
What is the different type of jobs in datastage?
Whats difference betweeen operational data stage (ods) and data warehouse?
On which interface you will be working as a developer?
What are the job parameters?
Define data aggregation?
What are the components of ascential data stage?
client know skid info?
Explain Quality stage?
how to get sum of sal based on dept_no and then sum of all sal irrespective of dept_no in same sql. output:- 10, 200(sum of sal for dept_no 10), 5000(sum of all sal)
