delete data from staging table as it loads to target table.here is the case
we are getting data from 3 different server.a b and c.the data from server A loaded into staging table and we ran the task and data loaded to target table.now today data from server B and C also got loaded to the staging table.now what techniques and what transformations should be used to delete only the data which has been loaded only to the target.we need to delete only that data from staging which has been loaded into the target.looking for your responses
Answers were Sorted based on User's Feedback
Answer / aparna
once the session loads the data to target ,truncate the staging table .So everytime we load is complete ,staging table will be empty .
In POST-SQL (Target ) : truncate the staging table .
| Is This Answer Correct ? | 3 Yes | 0 No |
Answer / ram
Hi,
for identification add a port like source_id in the stage table.
create 3 session instances to load data from 3 sources.
write pre sql in each session instance to delete the
records from stage table.
delete from <stage_table>
where id in (select id from target table)
and source_id=<identifiaction_value>;
please let me know the if you have any questions.
bhupalreddy200@gmail.com
thanks
ram
| Is This Answer Correct ? | 3 Yes | 2 No |
What is the commit type if you have a transaction control transformation in the mapping?
what is incremental aggregation ,with example?
HOw can we load the normalised data ( Vertical data) to (Horizontal data)with out using decode in the expression transformation and the aggregator transformation. But, what exactly I want is .. If we have million of records,it is not possible using decode and search for that Particular Id to pivot into Horizontal data... Can any one of guys please help me in this regard.....
Where do you create/define mapping parameter and mapping variable?
how to create a sample mapping for dynamic lookup transformation
What is the Hierarchy of DWH?
which transformation uses cache?
what is a time dimension? give an example?
What are data-driven sessions?
What are Dimensional table?
How to Create a folder using pmrep command?
How to update or delete the rows in a target, which do not have key fields?