Out of 4 mill records only 3 mill records are loaded to
target
and then job aborted. How to load only those 1 mill(not
loaded records) for next run.
This job is not sequential job, it is stand alone parallel
job.What are the possibilities available in datastage8.1?

Answer Posted / nish

there are plenty of options available.
just carefully study the scenario.

Source: 4 Mil records (doesn't change)
Target: 3 Million already loaded
Option1:
you just need to identify those 1Million pool them and then load to target.

This is clearly a case for Change Data Capture (CDC) stage.
use the Source As Before Table and Target as After.
Write those 1 Mil records based on change_code() (Deleted) to a file.
Move the contents of this file to target.

Option 2: This scenario also hints at updating the target with merge stage.use the DROP option to gather into a file and then update the target.

Option 3: Look Up being a performance concern should be your alternative.

Is This Answer Correct ?    2 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Define oconv () and iconv () functions in datastage?

871


what are the errors,warnings in datastage

2142


table actions available in oracle connector?

1084


What is merge stage?

758


What is the different type of jobs in datastage?

568






What is the difference between hashfile and sequential file?

711


what is the custome stage in datastage? how can we impliment that one? plz tell me

1904


What can we do with datastage director?

666


how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara

357


What is the Environment Variable need to Set to TRIM in Project Level?(In transfermer, we TRIM function but I need to impliment this project level using Environment variable)

1894


Could anyone give brief explanation bout datastage admin

1963


What is staging variable?

618


How will you move hashed file from one location to another location?

1651


How you can fix the truncated data error in datastage?

1188


There are two file are there .1st file contains 5 records and 2nd file contain 10 records in target they want 50 records.how can achieve this

1799