Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...

how to remove duplicates in transformer stage by using
stage variables?one example?

Answer Posted / amit

using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.

This will remove duplicate in transformer stage.

Is This Answer Correct ?    0 Yes 7 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is data partitioning?

1143


What is the difference between operational data stage (ods) and data warehouse?

1190


Difference between in process and inter process?

1172


What are sequencers?

1068


im new to this tool im now at project plz tell me step by step process how to design plz help me i wnt to go with exp for job plz give me d proper design and explination

2114


What could be a data source system?

954


Can you filter data in hashed file?

3731


for example You have One Table with 4 Columns (Mgr ID, Department ID, Salary, Employee ID). Can you find out the Average Salary and Number of Employee present per Department and Mgr

1307


Why we use surrogate key?

1165


Define Routines and their types?

1114


What is process model?

1930


In a batch if a job fails in between and you want to restart the batch from that particular job and not from the scratch then what will you do?

999


What is a datastage job?

973


Can you define merge?

1070


What is the use of hoursfromtime() function in transformer stage in datastage?

1007