i have seq file that contents 10 million records load to target any data base..
in that case it takes lot of time for loading..how do performance tuning in that situation...?
Answer Posted / subhash
1.Increase the 'Numbers Readers per Node' to '2' in source file.
2. Use the Bulk Load Option in Target Oracle Connector.
3. set option Re-Build Index option, so that it will drop indexes before loading and It will create the indexes once load is completed.
4. Increase the 'Record count'(set 10,000, should be multiple of Array size) in TGT.
5. Increase 'Array size'(set 5,000, default is 2,000) in TGT.
6. SRC---->COPY---->TGT,
use COPY stage, so, it work like buffer whenever there is diff in number records processing at source side and at target side.
| Is This Answer Correct ? | 10 Yes | 0 No |
Post New Answer View All Answers
create a job that splits the data in the Jobs.txt file into
four output files. You will direct the data to the
different output files using constraints. • Job name:
JobLevels
• Source file: Jobs.txt
• Target file 1: LowLevelJobs.txt
− min_lvl between 0 and 25 inclusive.
− Same column types and headings as Jobs.txt.
− Include column names in the first line of the output file.
− Job description column should be preceded by the
string “Job
Title:” and embedded within square brackets. For example, if
the job description is “Designer”, the derived value
is: “Job
Title: [Designer]”.
• Target file 2: MidLevelJobs.txt
− min_lvl between 26 and 100 inclusive.
− Same format and derivations as Target file 1.
• Target file 3: HighLevelJobs.txt
− min_lvl between 101 and 500 inclusive.
− Same format and derivations as Target file 1.
• Rejects file: JobRejects.txt
− min_lvl is out of range, i.e., below 0 or above 500.
− This file has only two columns: job_id and reject_desc.
− reject_desc is a variable-length text field, maximum
length
100. It should contain a string of the form: “Level out of
range:
Have you have ever worked in unix environment and why it is useful in datastage?
tell me 5 situations when we r using oracle db stages like orecle connector, oracle enterprise
What are the main features of datastage?
What is the difference between the local container and shared container?
What is merge stage?
What are the types of views in datastage director?
Highlight the main features of datastage?
whom do you report?
How will you load you daily/monthly jobs datas in to Fact and Dimension table using datastage.
What is the purpose of pivot stage?
Differentiate between odbc and drs stage?
Which is the best institute in Hyderabad to learn OBIEE and DataStage?Please tell me faculty name also
What is apt_config in datastage?
I have a few records just I want to store data in to targets cycling way how?