Out of 4 mill records only 3 mill records are loaded to
target
and then job aborted. How to load only those 1 mill(not
loaded records) for next run.
This job is not sequential job, it is stand alone parallel
job.What are the possibilities available in datastage8.1?
Answer Posted / nish
there are plenty of options available.
just carefully study the scenario.
Source: 4 Mil records (doesn't change)
Target: 3 Million already loaded
Option1:
you just need to identify those 1Million pool them and then load to target.
This is clearly a case for Change Data Capture (CDC) stage.
use the Source As Before Table and Target as After.
Write those 1 Mil records based on change_code() (Deleted) to a file.
Move the contents of this file to target.
Option 2: This scenario also hints at updating the target with merge stage.use the DROP option to gather into a file and then update the target.
Option 3: Look Up being a performance concern should be your alternative.
| Is This Answer Correct ? | 2 Yes | 0 No |
Post New Answer View All Answers
In Informatica,for the table I can find coreesponding dependent mappings.Likewise can I find the dependent jobs with all the information by using the table name
How to find value from a column in a dataset?
what is 'reconsideration error' and how can i respond to this error and how to debug this
What are the steps needed to create a simple basic datastage job?
How do you import and export the datastage jobs?
What can we do with datastage director?
What are the processing stages?
What are the main differences you have observed between 7.x and 8.x version of datastage?
What is the purpose of interprocessor stage in server jobs?
Is possible to create skid in dim,fact tables?
What is the difference between passive stage and active stage?
Difference between in process and inter process?
Can you explain how could anyone drop the index before loading the data in target in datastage?
Enlist various types of routines in datastage.
What are the enhancements made in datastage 7.5 compare with 7.0?