how can find maximum salary by using Remove duplicate stage?
Answers were Sorted based on User's Feedback
For RMD Stage we need Grouping Keys, Add one extra hard coded Column to each Input records in previous stage.
DUMMY=1
In RMD Stage,
HASH partition on DUMMY, Sort DESC on Salary
and select DUMMY as Key in properties tab.
"Duplicate to Retain"=First.
then you will get only Highest Salart only from RMD Stage
| Is This Answer Correct ? | 5 Yes | 0 No |
Answer / narayana.3ds
R.D Stage remove the duplicates every one knows but u can
find max salary......
Give the key of salary order by descending other
option u can put=first
| Is This Answer Correct ? | 5 Yes | 2 No |
Answer / phani kumar
By using Sort stage, sort the data in Descending order, then
use remove duplicates stage, set option as first occurrence
of records. Then we will get max sal record first.
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / akila
In case an explicit sort stage is used like inteh reply
above, the sort will be done on emp_id(key field) and the
salary. But remove duplicate will be done only on emp_id. I
guess that this might result in a warning like 'sort and
remove duplicates keys do not match'.
| Is This Answer Correct ? | 0 Yes | 0 No |
How can you find out whether datastage process is running or not in unix?
What are the components of datastage?
What is the difference between passive stage and active stage?
Define Data Stage?
what is the diff b/w switch and filter stage in datastage
what is the difference between lookup stage reject link and merge stage reject link in datastage Parallel jobs? interm of output in Merge Reject link and Look Up Reject link ?
What are the types of hashed files in data stage
how may datastage variables/parameters will be in trnsformer stage? 1 2 3 4 ?
what is the use of skid in reporting?
What is the purpose of pivot stage and types of containers in datastage
Star Schema vs. Snow Flake Schema. What is the best model for DW? Give example for both the models performance wise?
how many write modes are there in ds