Out of 4 mill records only 3 mill records are loaded to
target
and then job aborted. How to load only those 1 mill(not
loaded records) for next run.
This job is not sequential job, it is stand alone parallel
job.What are the possibilities available in datastage8.1?
Answer Posted / nish
there are plenty of options available.
just carefully study the scenario.
Source: 4 Mil records (doesn't change)
Target: 3 Million already loaded
Option1:
you just need to identify those 1Million pool them and then load to target.
This is clearly a case for Change Data Capture (CDC) stage.
use the Source As Before Table and Target as After.
Write those 1 Mil records based on change_code() (Deleted) to a file.
Move the contents of this file to target.
Option 2: This scenario also hints at updating the target with merge stage.use the DROP option to gather into a file and then update the target.
Option 3: Look Up being a performance concern should be your alternative.
| Is This Answer Correct ? | 2 Yes | 0 No |
Post New Answer View All Answers
What is the difference between hashfile and sequential file?
how many rows sorted in sort stage by default in server jobs
What is the process of killing a job in datastage?
file having these input and we have to get 3 output using same job Input 1 1 1 2 3 4 4 4 o/p1 o/p2 o/p3 1 1 2 2 1 3 3 1 4 4 4
What are routines in datastage? Enlist various types of routines.
What are the types of views in datastage director?
How can we improve performance of data stage jobs?
What is the difference between an operational datastage and a data warehouse?
Where do the datastage jobs get stored?
Can you explain link buffering?
Nls stands for what in datastage?
what is 'reconsideration error' and how can i respond to this error and how to debug this
What are datastage sequences?
Enlist various types of routines in datastage.
What is Ad-Hoc access? What is the difference between Managed Query and Ad-Hoc access?