how can find maximum salary by using Remove duplicate stage?
Answers were Sorted based on User's Feedback
For RMD Stage we need Grouping Keys, Add one extra hard coded Column to each Input records in previous stage.
DUMMY=1
In RMD Stage,
HASH partition on DUMMY, Sort DESC on Salary
and select DUMMY as Key in properties tab.
"Duplicate to Retain"=First.
then you will get only Highest Salart only from RMD Stage
| Is This Answer Correct ? | 5 Yes | 0 No |
Answer / narayana.3ds
R.D Stage remove the duplicates every one knows but u can
find max salary......
Give the key of salary order by descending other
option u can put=first
| Is This Answer Correct ? | 5 Yes | 2 No |
Answer / phani kumar
By using Sort stage, sort the data in Descending order, then
use remove duplicates stage, set option as first occurrence
of records. Then we will get max sal record first.
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / akila
In case an explicit sort stage is used like inteh reply
above, the sort will be done on emp_id(key field) and the
salary. But remove duplicate will be done only on emp_id. I
guess that this might result in a warning like 'sort and
remove duplicates keys do not match'.
| Is This Answer Correct ? | 0 Yes | 0 No |
What are stage variables and constants?
What is oci?
Explain Quality stage?
What are the primary usages of datastage tool?
How to perform incremental load in datastage?
Input file one has data as shown below 1 2 3 4 5 6 7 8 Input file two has data like 6 7 8 9 10 11 Design a data stage job which will provide me three output files as shown below: Output 1 6 7 8 Output 2 1 2 3 4 5 Output 3 9 10 11 Let me know your answers
how to handle null values in sequential file?
if i have two tables table1 table2 1a 1a,b,c,d 1b 2a,b,c,d,e 1c 1d 2a 2b 2c 2d 2e how can i get data as same as in tables?chandu how can i implement scd typ1 and type2 in both server and in parallel?chandu field1 field2 field3 suresh , 10,324 , 355 , 1234 ram , 23,456 , 450 , 456 balu ,40,346,23 , 275, 5678 how to remove the ,inthe fields?
How do u call shellscript/Batch file from DS?
in sequtial file 2 columns avaliable, i want only one column load the target. for this we can do by modify and copy stage. But here when using modify stage (in property drop column1) until it is ok. if target is data set How to view the data. with out using data management. what is the reason for this. if any body know this answer plz tel me. thanks.
Which algorithm you used for your hashfile?
Explain the ChangeApply stage?