Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
Answer Posted / dipal
step-1
Filter the record based on condition
Flag1=N AND Flag2=N ....link1
also defined a reject link
step-2
read link1 as left link and reject link as right link and
do inner join with Look up stage based on id
also define a reject link.
now the reject link will have required output.
| Is This Answer Correct ? | 3 Yes | 0 No |
Post New Answer View All Answers
Differentiate between datastage and informatica?
What is the difference between an operational datastage and a data warehouse?
CHANGE CAPTURE
Define ds designer?
What are the areas of application?
table actions available in oracle connector?
Can you explain engine tier in information server?
Distinguish between informatica & datastage. Which one would you choose and why?
Explain entity, attribute and relationship in datastage?
Does datastage support slowly changing dimensions ?
Could anyone give brief explanation bout datastage admin
What is the process of killing a job in datastage?
tell me 5 situations when we r using oracle db stages like orecle connector, oracle enterprise
Can you implement SCD2 using join, transformer and funnel stage?
What is the difference between account and directory options ?