A job is having only 2 stages I/p dataset and target table.Job is taking very long time to load 50 million records.How to improve performance of this job.
Answers were Sorted based on User's Feedback
Answer / tkm
1) Perform a bulk load into the target load.
2) If bulk load is already there, check whether the indexes (if any) in the target table are disabled or not.
3) Maybe you can check the configuration file to check how many nodes it is using and switch to a different configuration file having more number of nodes.
| Is This Answer Correct ? | 1 Yes | 0 No |
You can try to put a copy stage with force=True propertly. It can inhance the performance
http://goo.gl/atN4AT
www.datagenx.net
| Is This Answer Correct ? | 0 Yes | 0 No |
Check the DataStage Director job log for jobs which do not show job run statistics and confirm whether the following variable is defined:
APT_NO_JOBMON
If APT_NO_JOBMON is defined and set to value of 1 or true, then it will disable job monitoring and process metadata reporting for parallel jobs.
Confirm the JobMonApp process is up and running:
ps -ef | grep JobMonApp
default ports for JobMonApp is : 13400 and 13401
Both ports must be in listen state.
if you are getting this error: Failed to connect to JobMonApp on port 13401" please restart this service.
[root@ibmiis9 ~]# cd /opt/IBM/InformationServer/Server/PXEngine/
[root@ibmiis9 PXEngine]# export APT_ORCHHOME=`pwd`
[root@ibmiis9 PXEngine]# cd java/
[root@ibmiis9 java]# ./jobmoninit stop
JobMonApp has been shut down.
[root@ibmiis9 java]# ./jobmoninit start
JobMonApp has been started.
[root@ibmiis9 java]#
| Is This Answer Correct ? | 0 Yes | 1 No |
What are constraints and derivations?
Hi friends,Two input files, wants to validate only if the reference data has '0' otherwise no validation should be done..how to do this??
what is the use of skid in reporting?
What is active and passive stage?
A table containg 100 records B table containg 20 records we have to join two tables in left outer it containg target 100 records but target containg 101 record at that time what is the issue arise
col1 123 abc 234 def jkl 768 opq 567 789 but i want two targetss target1 contains only numeric values and target2 contains only alphabet values like trg1 123 234 768 567 789 trg2 abc def jkl opq
What are the functionalities of link collector?
Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?
explain how to create SCD-2 IN DATASTAGE 7.5X2 PLZ EXPLAIN WITH 4 OR 5 RECORDS TAKE IT EXAMPLE AND JOB DESINGN URGENT
What is RCP
How To find the location of APT_confid file
Difference between IBM DATA STAGE8.5 and DATA STAGE9.1 ?