A job is having only 2 stages I/p dataset and target table.Job is taking very long time to load 50 million records.How to improve performance of this job.
Answers were Sorted based on User's Feedback
Answer / tkm
1) Perform a bulk load into the target load.
2) If bulk load is already there, check whether the indexes (if any) in the target table are disabled or not.
3) Maybe you can check the configuration file to check how many nodes it is using and switch to a different configuration file having more number of nodes.
| Is This Answer Correct ? | 1 Yes | 0 No |
You can try to put a copy stage with force=True propertly. It can inhance the performance
http://goo.gl/atN4AT
www.datagenx.net
| Is This Answer Correct ? | 0 Yes | 0 No |
Check the DataStage Director job log for jobs which do not show job run statistics and confirm whether the following variable is defined:
APT_NO_JOBMON
If APT_NO_JOBMON is defined and set to value of 1 or true, then it will disable job monitoring and process metadata reporting for parallel jobs.
Confirm the JobMonApp process is up and running:
ps -ef | grep JobMonApp
default ports for JobMonApp is : 13400 and 13401
Both ports must be in listen state.
if you are getting this error: Failed to connect to JobMonApp on port 13401" please restart this service.
[root@ibmiis9 ~]# cd /opt/IBM/InformationServer/Server/PXEngine/
[root@ibmiis9 PXEngine]# export APT_ORCHHOME=`pwd`
[root@ibmiis9 PXEngine]# cd java/
[root@ibmiis9 java]# ./jobmoninit stop
JobMonApp has been shut down.
[root@ibmiis9 java]# ./jobmoninit start
JobMonApp has been started.
[root@ibmiis9 java]#
| Is This Answer Correct ? | 0 Yes | 1 No |
What is the method of removing duplicates, without the remove duplicate stage?
What is the purpose of pivot stage and types of containers in datastage
i have a table col1 10 20 30 40 10 20 50 my requirement is how to retrive only duplicates like 10 10 20 20 like this how it's possible in SQL?
what is difference between migration project and integration project? can anyone explain with the example Thanks in advance
What is oci?
How much data u can get every day? 2)which data ur project contains? 3) what is the source in ur project?what is the biggest table & size in ur schema or in ur project?
How to work with XML out put stage? Please explain step by step? i need to generate XML file using Table data. Given is the .XSD file. Please help?
Explain datastage architecture?
Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load only those 1 mill(not loaded records) for next run. This job is not sequential job, it is stand alone parallel job.What are the possibilities available in datastage8.1?
source file having the data like aabbccc, i want target file result like a1a2b1b2c1c2c3.
2.how u run your rotines in unix? what is job sequencer? if i have 4 jobs i would like to run 2 jobs in server(using job jobsequencer)and remaining 2 in parallel?how can i run?
How can one find bugs in job sequence?