how can find maximum salary by using Remove duplicate stage?
Answers were Sorted based on User's Feedback
For RMD Stage we need Grouping Keys, Add one extra hard coded Column to each Input records in previous stage.
DUMMY=1
In RMD Stage,
HASH partition on DUMMY, Sort DESC on Salary
and select DUMMY as Key in properties tab.
"Duplicate to Retain"=First.
then you will get only Highest Salart only from RMD Stage
| Is This Answer Correct ? | 5 Yes | 0 No |
Answer / narayana.3ds
R.D Stage remove the duplicates every one knows but u can
find max salary......
Give the key of salary order by descending other
option u can put=first
| Is This Answer Correct ? | 5 Yes | 2 No |
Answer / phani kumar
By using Sort stage, sort the data in Descending order, then
use remove duplicates stage, set option as first occurrence
of records. Then we will get max sal record first.
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / akila
In case an explicit sort stage is used like inteh reply
above, the sort will be done on emp_id(key field) and the
salary. But remove duplicate will be done only on emp_id. I
guess that this might result in a warning like 'sort and
remove duplicates keys do not match'.
| Is This Answer Correct ? | 0 Yes | 0 No |
What are stage variables, derivations and constants?
Notification Activity
Hi, i did what you mentioned in the answer, i.e. source- >Transformer -> 3 datasets. Iam able to see the data in datasets but its not sort order... Can you tell how sort the data?? i also checked Hash partition with performsort.
how to implement scd2 in datastage 7.5 with lookup stage
Which algorithm you used for your hashfile?
I am running a job with 1000 records.. If the job gots aborted after loading 400 records into target... In this case i want to load the records in the target with 401 record... How will we do it??? This scenario is not for sequence job it's only in the job Ex: Seq file--> Trans--> Dataset..
9 Answers Cognizant, IBM, TCS, Virtusa,
How can i approach to write datastage 7.5 Certification? and how much they will charge for examination .What exactly should i do? Can anyone guide me plz?
What is the difference between hashfile and sequential file?
Can we use Round Robin for aggregator?is there any benefit underlying?
How to read multiple files using a single datastage job if files have the same metadata?
I have oracle enterpaise stage, oracle bulkloader stage, ODBC stage and I want to load data in to target, which of the above stages do I need to use and why?
which memory is used by lookup and join