Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
- 2 Answers
- 4683 Views
- I also Faced
- E-Mail Answers
Answer Posted / dipal
step-1
Filter the record based on condition
Flag1=N AND Flag2=N ....link1
also defined a reject link
step-2
read link1 as left link and reject link as right link and
do inner join with Look up stage based on id
also define a reject link.
now the reject link will have required output.
| Is This Answer Correct ? | 3 Yes | 0 No |
Post New Answer View All Answers
How one source columns or rows to be loaded in to two different tables?
Define Merge?
Explain the datastage parallel extender (px) or enterprise edition (ee)?
project Steps,hits, Project level HArd things,Solved methods?
file having these input and we have to get 3 output using same job Input 1 1 1 2 3 4 4 4 o/p1 o/p2 o/p3 1 1 2 2 1 3 3 1 4 4 4
In Informatica,for the table I can find coreesponding dependent mappings.Likewise can I find the dependent jobs with all the information by using the table name
Demonstrate experience in maintaining quality process standards?
Can you define merge?
What is "fatal error/rdbms code 3996" error?
How to read the length of word in unix?
What are the main differences you have observed between 7.x and 8.x version of datastage?
what is the custome stage in datastage? how can we impliment that one? plz tell me
hi iam new to this tooliam cmpltied to know abt datastage so now iam in project tell me whole step by step what iam doing iwnt to go with exp so plz hlp me pals
Describe routines in datastage? Enlist various types of routines.
Differentiate between operational datastage (ods) and data warehouse?
