how to remove duplicates in transformer stage by using
stage variables?one example?
- 6 Answers
- 31001 Views
- Syntel, TCS, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / ds
In Stage variable:
stage_variable3 <map> stage_variable1
if column=stage_variable1 than 0 else 1 <map>
stage_variable2
column <map> stage_variable3
Put stage_variable2 as constrain to target stage.
| Is This Answer Correct ? | 12 Yes | 2 No |
Answer / venu
if you want to remove duplicates in transformer stage
use one of the partition technic hash partition you can
easily remove duplicatess
| Is This Answer Correct ? | 8 Yes | 2 No |
Answer / peeyush sehgal
sv1=inputlink
sv2=if inputlink=sv3 then 1 else 0
sv3=sv1
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / prasad
take two stage variables
sV1: Input_column
sV2: if Input_column = sV1 then 0 else 1
and put 'sV1=1' as constraint
Plz correct me, If am wrong.....
| Is This Answer Correct ? | 4 Yes | 7 No |
Answer / amit
using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.
This will remove duplicate in transformer stage.
| Is This Answer Correct ? | 0 Yes | 7 No |
Answer / subodh
duplication of transformer stage is removed b7y using a
call by referance and call by value , using we create one
object and no other duplication is done
| Is This Answer Correct ? | 1 Yes | 14 No |
hi, how would i run job1 then job 3 , then job2 in a sequence of job1 ,job2,job3. Thanks sunitha
What is a quality stage in datastage tool?
how can we create a Sorrogate key in transformer stage? I want it in parallel mode
What is the purpose of pivot stage and types of containers in datastage
HOw Hash Partion Works Thank you in Advance i have doubts on Hash Partion TEch Could please give me the clear understandable notation example e_id,dept_no 1,10 2,10 3,20 4,20 5,30 6,40 i have TWo Nodes/Three Nodes My questions are: 1).if i select hash key as e_id how Hash partion will distribute the data in to two NOdes/three NOdes 2).if i select hash key as dept_no how Hash partion will distribute the data in to two NOdes/three NOdes sivakumar.katta7@gmail.com
Have you used Unstructured data?
In my project source data comes from MAINFRAME in files.so,This time data is coming as a binary file...I know for binary data we use Complex flat file stage..I have used it also..but on 'view data' data is not coming correctly..as it in MAINFRAME.give me some ideas..
Source contains the metadata source ----- hyderabad,chennai,bangalore by using nested loop sequence select source as hyderabad in target just run target as hyderabad only not others please give me answer thanks in advance(give reply how to wrote logic using nested loop sequence)
how to run a sequential file stage in parallel if the stage is used on the TARGET side
it is possible to load two tables data into one sequential file?if possible how?plz share with me?
Hi, I have 3 records, 1 Srini 1 vasa 2 reddy now i want o/p like this 1 Srinivasa 2 reddy could u please help in this Thanks in advance.
A flatfile contains 200 records.I want to load first 50 records at first time running the job,second 50 records at second time running and so on,how u can develop the job?pls give the steps?pls pls
Teradata 
