A job is having only 2 stages I/p dataset and target table.Job is taking very long time to load 50 million records.How to improve performance of this job.
Answers were Sorted based on User's Feedback
Answer / tkm
1) Perform a bulk load into the target load.
2) If bulk load is already there, check whether the indexes (if any) in the target table are disabled or not.
3) Maybe you can check the configuration file to check how many nodes it is using and switch to a different configuration file having more number of nodes.
| Is This Answer Correct ? | 1 Yes | 0 No |
You can try to put a copy stage with force=True propertly. It can inhance the performance
http://goo.gl/atN4AT
www.datagenx.net
| Is This Answer Correct ? | 0 Yes | 0 No |
Check the DataStage Director job log for jobs which do not show job run statistics and confirm whether the following variable is defined:
APT_NO_JOBMON
If APT_NO_JOBMON is defined and set to value of 1 or true, then it will disable job monitoring and process metadata reporting for parallel jobs.
Confirm the JobMonApp process is up and running:
ps -ef | grep JobMonApp
default ports for JobMonApp is : 13400 and 13401
Both ports must be in listen state.
if you are getting this error: Failed to connect to JobMonApp on port 13401" please restart this service.
[root@ibmiis9 ~]# cd /opt/IBM/InformationServer/Server/PXEngine/
[root@ibmiis9 PXEngine]# export APT_ORCHHOME=`pwd`
[root@ibmiis9 PXEngine]# cd java/
[root@ibmiis9 java]# ./jobmoninit stop
JobMonApp has been shut down.
[root@ibmiis9 java]# ./jobmoninit start
JobMonApp has been started.
[root@ibmiis9 java]#
| Is This Answer Correct ? | 0 Yes | 1 No |
what is the use of surogate key in datastage
What's the Main Function of the Staging area in DWH
when u face critical situation in ur project, how to solve them?
Can you highlight the main features of ibm infosphere information server?
Main Function of the Staging area in DWH ?
source has 2 fields like COMPANY LOCATION IBM HYD TCS BAN IBM CHE HCL HYD TCS CHE IBM BAN HCL BAN HCL CHE LIKE THIS....... AND I WILL GET THE OUTPUT LIKE THIS.... Company loc count TCS HYD 3 BAN CHE IBM HYD 3 BAN CHE HCL HYD 3 BAN CHE PLZ SEND ME ANSWER FOR THIS QUESTION..........
count number of deptno in a emp table?
Describe the main features of datastage?
Create a job to load all unique products in one table and the duplicate rows in to another table. The first table should contain the following output A D The second target should contain the following output B B B C C Q2. Create a job to load each product once into one table and the remaining products which are duplicated into another table. The first table should contain the following output A B C D The second table should contain the following output B B C
for example You have One Table with 4 Columns (Mgr ID, Department ID, Salary, Employee ID). Can you find out the Average Salary and Number of Employee present per Department and Mgr
What are the primary usages of datastage tool?
Difference between in process and inter process?