how to design the change capture stage in(data stage
parallel jobs) type 2
- 2 Answers
- 48230 Views
- IBM, I also Faced
- E-Mail Answers
Answer Posted / pooja
Let me just elaborate the earlier answer clearly.
1. Two input datasets are required for change data caputure
stage.
One is Old dataset
Second is New or updated dataset
2. Give in the 2 inputs to the change capture stage and the
target as a dataset.
3. Let the incoming data be sorted based on a key column(s)
for performance purpose in the change Caputure stage.
4. Upon executing the job, the data when viewed from the
dataset shows a new column added apart from the output
data. A change code column would be generated in the change
capture stage having values as 0, 1, 2, 3 which depicts the
changes on comparing the 2 input datasets such as copy(0),
Insert(1), Delete(2), Edit(3).
5. See what kind of data you need in the output target like
copy, insert, delete, edit.
6. To apply SCD Type 2 we require Start date and End date
columns.
7. The Change Capture Stage output is given to a
Transformer Stage, where 2 new columns are generated with
Effective Start Date and End Date.
8. If you need all Inserted or new data to be passed in to
a particular dataset then you need to specify an
appropriate condition in the Transformer Stage to the
outgoing link. Ex. Drop Output For insert=true
9. In the similar way other data can also be captured or a
Filter can also be used after the Transformer Stage to
filter the data into the targets based on the requirement.
| Is This Answer Correct ? | 36 Yes | 4 No |
Post New Answer View All Answers
sed,awk,head
What is the process of killing a job in datastage?
Describe stream connector?
Name the command line functions to import and export the DS jobs?
What is active and passive stage?
What is the difference between operational data stage (ods) and data warehouse?
Define ds designer?
How to implement complex jobs in data stage?
How do you generate sequence number in datastage?
What is difference between symmetric multiprocessing and massive parallel processing?
Can you explain repository tables in datastage?
What is the purpose of interprocessor stage in server jobs?
Differentiate between hash file and sequential file?
How to perform incremental load in datastage?
What are the some differences between 7.x and 8.x version of datastage?
