Interested to Buy Any Domain ? << Click Here >> for more details...
Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
- 2 Answers
- 5723 Views
- I also Faced
- E-Mail Answers
Answer Posted / dipal
step-1
Filter the record based on condition
Flag1=N AND Flag2=N ....link1
also defined a reject link
step-2
read link1 as left link and reject link as right link and
do inner join with Look up stage based on id
also define a reject link.
now the reject link will have required output.
| Is This Answer Correct ? | 3 Yes | 0 No |
Post New Answer View All Answers
How many Key we can define in remove duplicate stage?
Difference between sequential file and data set?
WAT TYPE OF PL/SQL QUERRYS USED IN DATASTAGE
I have a few records just I want to store data in to targets cycling way how?
Notification Activity
Define Job control?
Whats difference betweeen operational data stage (ods) and data warehouse?
i WANTED TO USE THE RANGE LOOKUP SCENARIO IN DATASTAGE 7.5.2 SRVER JOB.i HAVE A DATE FIELD IN SOURCE AND I SHOULD MATCH IT WITH A FIELD IN LOOKUP FILE.BUT,THE FIELDS SHOULD MATCH EVEN THOUGH THERE IS SOME RANGE.CAN SOMEONE TELL ME HOW CAN I DO THAT. THANKS
There are two file are there .1st file contains 5 records and 2nd file contain 10 records in target they want 50 records.how can achieve this
in oracle target stage when we use load option and when we use upsert option?
how to run a sequential file stage in parallel if the stage is used on the TARGET side
How do you start developing a datastage project?
describe the Steps to confiure a Qlogic switch
What is the precedence of stage variables,derivations, and constraints?
What is data partitioning?
