1. Categories >> Software >> Data Warehouse >> Data Stage
  2. Suggest New Category

i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?

Question Posted / subhash

Answer Posted / subhash

1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.

Is This Answer Correct ?    10 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What are the important features of datastage?

611

Enlist various types of routines in datastage.

639

What is meta stage?

573

What is difference between symmetric multiprocessing and massive parallel processing?

647

Hi everyone,I have kept a project Sales And Distribution for a pharmaceutical company.can anybody explain one complex business rule that we had in our project and how did you accomplish it using DS?

1751




What is data partitioning?

739

How to reverse the string using unix?

2793

how to read 100 records at a time in source a) hw is it fr metadata Same and b) if metadata is nt same?

1712

i have a job with 3 possibiliies finish with ststus ok abbort warning how do you handle these 3 in job sequence? explain the situation where you have appiled scd in your project? chandu

2266

What steps should be taken to improve Datastage jobs?

634

Is it possible to implement parallelism in Mainframe Jobs ? If Yes how ? If no why ?

1773

EXPLAIN SCD

952

Differentiate between operational datastage (ods) and data warehouse?

668

i WANTED TO USE THE RANGE LOOKUP SCENARIO IN DATASTAGE 7.5.2 SRVER JOB.i HAVE A DATE FIELD IN SOURCE AND I SHOULD MATCH IT WITH A FIELD IN LOOKUP FILE.BUT,THE FIELDS SHOULD MATCH EVEN THOUGH THERE IS SOME RANGE.CAN SOMEONE TELL ME HOW CAN I DO THAT. THANKS

3309

What is the difference between datastage and datastage tx?

588