A job is having only 2 stages I/p dataset and target table.Job is taking very long time to load 50 million records.How to improve performance of this job.
Answers were Sorted based on User's Feedback
Answer / tkm
1) Perform a bulk load into the target load.
2) If bulk load is already there, check whether the indexes (if any) in the target table are disabled or not.
3) Maybe you can check the configuration file to check how many nodes it is using and switch to a different configuration file having more number of nodes.
| Is This Answer Correct ? | 1 Yes | 0 No |
You can try to put a copy stage with force=True propertly. It can inhance the performance
http://goo.gl/atN4AT
www.datagenx.net
| Is This Answer Correct ? | 0 Yes | 0 No |
Check the DataStage Director job log for jobs which do not show job run statistics and confirm whether the following variable is defined:
APT_NO_JOBMON
If APT_NO_JOBMON is defined and set to value of 1 or true, then it will disable job monitoring and process metadata reporting for parallel jobs.
Confirm the JobMonApp process is up and running:
ps -ef | grep JobMonApp
default ports for JobMonApp is : 13400 and 13401
Both ports must be in listen state.
if you are getting this error: Failed to connect to JobMonApp on port 13401" please restart this service.
[root@ibmiis9 ~]# cd /opt/IBM/InformationServer/Server/PXEngine/
[root@ibmiis9 PXEngine]# export APT_ORCHHOME=`pwd`
[root@ibmiis9 PXEngine]# cd java/
[root@ibmiis9 java]# ./jobmoninit stop
JobMonApp has been shut down.
[root@ibmiis9 java]# ./jobmoninit start
JobMonApp has been started.
[root@ibmiis9 java]#
| Is This Answer Correct ? | 0 Yes | 1 No |
What is lookup table?
What is a merge?
Difference between data warehousing and olap?
Describe routines in datastage? Enlist various types of routines.
how can we perform the 2nd time extraction of client database without accepting the data which is already loaded in first time extraction
A flatfile contains 200 records.I want to load first 50 records at first time running the job,second 50 records at second time running and so on,how u can develop the job?pls give the steps?pls pls
source file having the data like aabbccc, i want target file result like a1a2b1b2c1c2c3.
I have source file which contains duplicate data,my requirement is unique data should pass to one file and duplicate data should pass another file how?
explain unit testing,systemtesting,integrated testing
i have flat file and using unix how can i generate sequence number into targer?
what is a message handler
how to abort the job its matain duplicates?