how to design the change capture stage in(data stage parallel jobs) type 2

how to design the change capture stage in(data stage
parallel jobs) type 2

Question Posted / venkat.sayempu

2 Answers
48250 Views
IBM, I also Faced
E-Mail Answers

Answers were Sorted based on User's Feedback

how to design the change capture stage in(data stage parallel jobs) type 2..

Answer / pooja

Let me just elaborate the earlier answer clearly.

1. Two input datasets are required for change data caputure
stage.
One is Old dataset
Second is New or updated dataset

2. Give in the 2 inputs to the change capture stage and the
target as a dataset.

3. Let the incoming data be sorted based on a key column(s)
for performance purpose in the change Caputure stage.

4. Upon executing the job, the data when viewed from the
dataset shows a new column added apart from the output
data. A change code column would be generated in the change
capture stage having values as 0, 1, 2, 3 which depicts the
changes on comparing the 2 input datasets such as copy(0),
Insert(1), Delete(2), Edit(3).

5. See what kind of data you need in the output target like
copy, insert, delete, edit.

6. To apply SCD Type 2 we require Start date and End date
columns.

7. The Change Capture Stage output is given to a
Transformer Stage, where 2 new columns are generated with
Effective Start Date and End Date.

8. If you need all Inserted or new data to be passed in to
a particular dataset then you need to specify an
appropriate condition in the Transformer Stage to the
outgoing link. Ex. Drop Output For insert=true

9. In the similar way other data can also be captured or a
Filter can also be used after the Transformer Stage to
filter the data into the targets based on the requirement.

Is This Answer Correct ?

36 Yes

4 No

how to design the change capture stage in(data stage parallel jobs) type 2..

Answer / nidhi

1.for change capture stafe u need two input dataset one is
old one & second is the new or updated one.
2. incoming data should be sorted.
3. allow what kind of u need to check like new , delete,
change,copy.
4. if u wanna all new data should be passed to the outgoing
link then u need to specify Drop Output For insert=true.
5.there should be a change key or change key value, on the
basis of key data will be chaecked.
thanks

Is This Answer Correct ?

16 Yes

5 No

Post New Answer