how to design the change capture stage in(data stage
parallel jobs) type 2
Answer Posted / pooja
Let me just elaborate the earlier answer clearly.
1. Two input datasets are required for change data caputure
stage.
One is Old dataset
Second is New or updated dataset
2. Give in the 2 inputs to the change capture stage and the
target as a dataset.
3. Let the incoming data be sorted based on a key column(s)
for performance purpose in the change Caputure stage.
4. Upon executing the job, the data when viewed from the
dataset shows a new column added apart from the output
data. A change code column would be generated in the change
capture stage having values as 0, 1, 2, 3 which depicts the
changes on comparing the 2 input datasets such as copy(0),
Insert(1), Delete(2), Edit(3).
5. See what kind of data you need in the output target like
copy, insert, delete, edit.
6. To apply SCD Type 2 we require Start date and End date
columns.
7. The Change Capture Stage output is given to a
Transformer Stage, where 2 new columns are generated with
Effective Start Date and End Date.
8. If you need all Inserted or new data to be passed in to
a particular dataset then you need to specify an
appropriate condition in the Transformer Stage to the
outgoing link. Ex. Drop Output For insert=true
9. In the similar way other data can also be captured or a
Filter can also be used after the Transformer Stage to
filter the data into the targets based on the requirement.
| Is This Answer Correct ? | 36 Yes | 4 No |
Post New Answer View All Answers
Differentiate between data file and descriptor file?
What is the process of killing a job in datastage?
What is a datastage job?
What is the difference between in process and inter process?
How to manage date conversion in Datastage?
If you want to use a same piece of code in different jobs, how will you achieve this?
how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara
What is difference between server jobs & parallel jobs?
How to reverse the string using SQL?
What is usage analysis in datastage?
What are the areas of application?
What are the types of containers and how to create them?
Define Routines and their types?
What is a ds designer?
Is it possible to implement parallelism in Mainframe Jobs ? If Yes how ? If no why ?