Interested to Buy Any Domain ? << Click Here >> for more details...
How to remove duplicates in transformer stage? in parallel
mode
- 6 Answers
- 17651 Views
- Syntel, TCS, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / kiran
partition the data by key and sort the data and click on
unique value. This will automatically delete duplicate
data.
| Is This Answer Correct ? | 20 Yes | 3 No |
Answer / praveen sarva
STEP 1) TRANSFORMER STAGE PROPERTIES--> ADVANCED -->
EXECUTION MODE ---> PARLLEL
STEP 2) TRANSFORMER STAGE PROPERTIES --> INPUT -->
PARTITIONING--> PARTITION TYPE --> HASH ---> ENABLE SORT ---
> ENABLE UNIQUE
Simple u will get non duplicate records....
| Is This Answer Correct ? | 11 Yes | 0 No |
Answer / kiran
i am not sure who marked my answer as wrong. Can you please
be responsible enough to state why its wrong?
| Is This Answer Correct ? | 1 Yes | 0 No |
Answer / satya
run u r job in sequencial mode and sort the source data
then play with stage variable's in Transformer.
because in parallel mode data is partioned .
| Is This Answer Correct ? | 1 Yes | 1 No |
Answer / prasad
Take 2 Stage variables in transformer stage
sV1 =Column_Name
sV2 =if Column_Name=sV1 Then 0 Else 1
put it constraint sV2=1 (only will get unique records)
if u want duplicates sV2=0
| Is This Answer Correct ? | 0 Yes | 1 No |
Answer / santhosh
go to transformer stage properties->input->define any kind of partition over there and enable perform sort check box....
n also define the particular column need to be sorted..
it gives the sorted column out view...
| Is This Answer Correct ? | 1 Yes | 6 No |
tell me abt Datastage trigger?
Wat is pre-load in Hashed file
what is a message handler
What is the importance of the exception activity in datastage?
What is the difference between Link collector and Funnel Stages?
2.how u run your rotines in unix? what is job sequencer? if i have 4 jobs i would like to run 2 jobs in server(using job jobsequencer)and remaining 2 in parallel?how can i run?
What are the prerequisites for join stage
EXPLAIN SCD
how to find diff between 2 dates without using Icon... funtions?
what is main difference between change capture and change apply stages
I have a few records just I want to store each records tow times in target how?
Can you explain engine tier in information server?
Teradata 
