how many types of remove the duplicate records?
Answer Posted / soumya
1. Sort the Data using a key column then Use 3 transformer stage Variable
SV1 = Col1
SV2 = If SV1 = SV3 then 'DUP' else 'UNQ'
SV3 (Initial value = 0)
In the constraint SV2 = 'DUP' or SV2 = 'UNQ'
2. Aggregater stage group by key col (col1) count the column
then a filter stage use count col > 1.
| Is This Answer Correct ? | 1 Yes | 2 No |
Post New Answer View All Answers
Explain the importance of surrogate key in data warehousing?
project Steps,hits, Project level HArd things,Solved methods?
What are stage variables, derivations and constants?
Define oconv () and iconv () functions in datastage?
What a datastage macro?
Which warehouse using in your datawarehouse
if we using two sources having same meta data and how to check the data in two sources is same or not? and if the data is not same i want to abort the job ?how we can do this?
What are the types of views in datastage director?
What is quality stage?
What is orabulk stage?
State the difference between an operational datastage and a data warehouse?
What is process model?
Which algorithm you used for your hashfile?
What are the functionalities of link collector?
Differentiate between datastage and informatica?