how to remove duplicates in transformer stage by using
stage variables?one example?
Answer Posted / amit
using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.
This will remove duplicate in transformer stage.
| Is This Answer Correct ? | 0 Yes | 7 No |
Post New Answer View All Answers
What is data partitioning?
What is the difference between operational data stage (ods) and data warehouse?
Difference between in process and inter process?
What are sequencers?
im new to this tool im now at project plz tell me step by step process how to design plz help me i wnt to go with exp for job plz give me d proper design and explination
What could be a data source system?
Can you filter data in hashed file?
for example You have One Table with 4 Columns (Mgr ID, Department ID, Salary, Employee ID). Can you find out the Average Salary and Number of Employee present per Department and Mgr
Why we use surrogate key?
Define Routines and their types?
What is process model?
In a batch if a job fails in between and you want to restart the batch from that particular job and not from the scratch then what will you do?
What is a datastage job?
Can you define merge?
What is the use of hoursfromtime() function in transformer stage in datastage?