A job is having only 2 stages I/p dataset and target table.Job is taking very long time to load 50 million records.How to improve performance of this job.
Answers were Sorted based on User's Feedback
Answer / tkm
1) Perform a bulk load into the target load.
2) If bulk load is already there, check whether the indexes (if any) in the target table are disabled or not.
3) Maybe you can check the configuration file to check how many nodes it is using and switch to a different configuration file having more number of nodes.
| Is This Answer Correct ? | 1 Yes | 0 No |
You can try to put a copy stage with force=True propertly. It can inhance the performance
http://goo.gl/atN4AT
www.datagenx.net
| Is This Answer Correct ? | 0 Yes | 0 No |
Check the DataStage Director job log for jobs which do not show job run statistics and confirm whether the following variable is defined:
APT_NO_JOBMON
If APT_NO_JOBMON is defined and set to value of 1 or true, then it will disable job monitoring and process metadata reporting for parallel jobs.
Confirm the JobMonApp process is up and running:
ps -ef | grep JobMonApp
default ports for JobMonApp is : 13400 and 13401
Both ports must be in listen state.
if you are getting this error: Failed to connect to JobMonApp on port 13401" please restart this service.
[root@ibmiis9 ~]# cd /opt/IBM/InformationServer/Server/PXEngine/
[root@ibmiis9 PXEngine]# export APT_ORCHHOME=`pwd`
[root@ibmiis9 PXEngine]# cd java/
[root@ibmiis9 java]# ./jobmoninit stop
JobMonApp has been shut down.
[root@ibmiis9 java]# ./jobmoninit start
JobMonApp has been started.
[root@ibmiis9 java]#
| Is This Answer Correct ? | 0 Yes | 1 No |
What is ds designer?
WAT TYPE OF PL/SQL QUERRYS USED IN DATASTAGE
How to display all the duplicate records from the oracle Table?
Define data aggregation?
how to define satge variables in transformer stage
What is oci?
i 10 jobs first two jobs are runing in 2nodes,next 2 jobs are running in 4 nodes, next 4 jobs are running in 6 nodes and the remaining jobs are running on 10 nodes. how to change the node configuration?
how to abort the job its matain duplicates?
What is the sortmerge collector?
How did you reconcile source with target?
I am running a job with 1000 records.. If the job gots aborted after loading 400 records into target... In this case i want to load the records in the target with 401 record... How will we do it??? This scenario is not for sequence job it's only in the job Ex: Seq file--> Trans--> Dataset..
9 Answers Cognizant, IBM, TCS, Virtusa,
create a job to get the previous row salary for the current row.if there is no previous row exists for the current row,then the previous row salary should be displayed as null? empid salary previoussalary 10 1000 null 20 2000 1000 30 3000 2000 40 4000 3000