how many types of remove the duplicate records?
Answer Posted / soumya
1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'
2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.
| Is This Answer Correct ? | 1 Yes | 2 No |
Post New Answer View All Answers
How do you reject records in a transformer?
Lookup constraints
What is the different type of jobs in datastage?
What is the importance of the exception activity in datastage?
project Steps,hits, Project level HArd things,Solved methods?
What are the job parameters?
Explain the datastage parallel extender (px) or enterprise edition (ee)?
What is usage analysis in datastage?
Differentiate between hash file and sequential file?
What are the types of containers and how to create them?
Explain how a source file is populated?
How can we improve performance of data stage jobs?
How to implement complex jobs in data stage?
Which algorithm you used for your hashfile?
What are datastage sequences?