i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?
- 5 Answers
- 13143 Views
- TCS, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.
| Is This Answer Correct ? | 10 Yes | 0 No |
Answer / krishna
1) In sequential stage we have stage properties on that
select options and increase the readers
2) In datastage admin we have on environmental variable like
logical reader that set as one
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / bharath
It can be achieved by DEGREE OF PARALLELISM.
i.e, we can configure the multiple nodes in the configuration
file. In configuration file we can specify multiple nodes..
| Is This Answer Correct ? | 2 Yes | 3 No |
Answer / prasad
In Seq file, we have one property called no. of readers/node(by default is one)=4 and
in Target table use "Bulk load" and also use Round Robin partition.
first drop index before loading data and once data loaded then re-create index again.
Plz correct me, if i am wrong.....
| Is This Answer Correct ? | 0 Yes | 1 No |
in aggregator , how can i get the sum in readable format
how to identifie,is it innerjoin,leftouter join in lookup?
i have a small question for datastage, After the desinging (i.e., transformations and loading)part, what we can do?
Source Like department_no, employee_name ---------------------------- 20, R 10, A 10, D 20, P 10, B 10, C 20, Q 20, S and Output should be like this department_no, employee_list -------------------------------- 10, A 10, A,B 10, A,B,C 10, A,B,C,D 20, A,B,C,D,P 20, A,B,C,D,P,Q 20, A,B,C,D,P,Q,R 20, A,B,C,D,P,Q,R,S
What a datastage macro?
How can remove duplicates in a file using UNIX?
iam new to datastage...now i want to know what are fact tables, dimension tables in bank domain...if any body knows plz tell me asap..
Which commands are used to import and export the datastage jobs?
Hi All , in PX Job I have passed 4 Parameters and when i run the same job in sequence i dont want to use those parameters , is this possible if yes then how
im new to this tool im now at project plz tell me step by step process how to design plz help me i wnt to go with exp for job plz give me d proper design and explination
How can we perform 2nd time extraction of client database without accepting the data which is already loaded in first time extraction?
guys pls tell me where we use sequence jobs exactly in realtime proj explain pls with example.
Teradata 
