how to remove duplicates in transformer stage by using
stage variables?one example?
Answers were Sorted based on User's Feedback
Answer / ds
In Stage variable:
stage_variable3 <map> stage_variable1
if column=stage_variable1 than 0 else 1 <map>
stage_variable2
column <map> stage_variable3
Put stage_variable2 as constrain to target stage.
| Is This Answer Correct ? | 12 Yes | 2 No |
Answer / venu
if you want to remove duplicates in transformer stage
use one of the partition technic hash partition you can
easily remove duplicatess
| Is This Answer Correct ? | 8 Yes | 2 No |
Answer / peeyush sehgal
sv1=inputlink
sv2=if inputlink=sv3 then 1 else 0
sv3=sv1
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / prasad
take two stage variables
sV1: Input_column
sV2: if Input_column = sV1 then 0 else 1
and put 'sV1=1' as constraint
Plz correct me, If am wrong.....
| Is This Answer Correct ? | 4 Yes | 7 No |
Answer / amit
using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.
This will remove duplicate in transformer stage.
| Is This Answer Correct ? | 0 Yes | 7 No |
Answer / subodh
duplication of transformer stage is removed b7y using a
call by referance and call by value , using we create one
object and no other duplication is done
| Is This Answer Correct ? | 1 Yes | 14 No |
I have a few records all are same structures data, I want to store data in multiple targets how?
how many types of sorting the data in data stage?
source file contains 100 records, i want 10 records in target file how it possible in datastage
Hi Can any one help regarding below INPUT NAME LOC Ram hyd Ram ban Raj chn Raj Pun Sam del OUPUT NAME LOC Ram Hyd ban Raj chn pun sam del
convert yyyy mm dd to dd mm yyyy?
Hi guys, please design a job with derivation(solution). write exact conditions. My requirement Source table emp_no qualification 1 a 1 c 2 a 3 c 3 b Target table emp_no qualification 1 b 2 b 2 c 3 a Here every employer have three qualifications i.e a,b and c. what ever source table dont have some qualification, that will be move to target table. Like above. Hope u get the point. Thanks.
What is the version control how can i apply this in DataStage can any one tell me the anser
disign the complex job in u r project?(they are aksing only complex job design and then data flow...)
How many types of hash files are there?
What is the difference between orabulk and bcp stages?
hi my source is:: empno,deptno,salary 1, 10, 3.5 2, 20, 8 2, 10, 4.5 1, 30, 5 3, 10, 6 3, 20, 4 1, 20, 9 then target should be in below form... empno,max(salary),min(salary),deptno 1, 9, 3.5, 20 2, 8, 4.5, 20 3, 6, 4, 10 can anyone give data flow in data stage for the above scenario.... thanks in advance...
If there is a file that contains 1000 records, I need the ouput to contain these 1000 records with the header as file name concatenated with the current timestamp and trailer as the count of records