how many types of remove the duplicate records?
- 3 Answers
- 10093 Views
- Caterpillar, I also Faced
- E-Mail Answers
Answer Posted / soumya
1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'
2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.
| Is This Answer Correct ? | 1 Yes | 2 No |
Post New Answer View All Answers
What are the functionalities of link partitioner and link collector?
How we can covert server job to a parallel job?
how to connect source to db?generally what r stages u used? how to find the data is having delimiter format?
What is difference between join, merge and lookup stage?
what is 'reconsideration error' and how can i respond to this error and how to debug this
Where the datastage stored his repository?
What a datastage macro?
What is the roundrobin collector?
hi.... am facing typical problem in every interview " I need some critical scenarios faced in real time" plz help me guys
Explain entity, attribute and relationship in datastage?
Can you explain repository tables in datastage?
Is it possible to implement parallelism in Mainframe Jobs ? If Yes how ? If no why ?
Differentiate between Join, Merge and Lookup stage?
Can you explain tagbatch restructure operator?
Is it possible to query a hash file?
