Interested to Buy Any Domain ? << Click Here >> for more details...
Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
- 2 Answers
- 5640 Views
- I also Faced
- E-Mail Answers
Answer Posted / vz
Put a constraint in Transformer stage as shown bellow.
flag1=y or flag2=y
means
feald1=y or feald2=y
I think it's help you.
| Is This Answer Correct ? | 3 Yes | 1 No |
Post New Answer View All Answers
Can you explain engine tier in information server?
Explain entity, attribute and relationship in datastage?
I/p : F1 table have A,B,C,D,E and F2 table having C,E,V i need output 0utput1: ABD output2: V any one suggest me this
How to find value from a column in a dataset?
Enlist various types of routines in datastage.
What is use Array size in datastage
How many Key we can define in remove duplicate stage?
What is datastage?
What is the purpose of interprocessor stage in server jobs?
What could be a data source system?
Define APT_CONFIG in Datastage?
Can you explain how could anyone drop the index before loading the data in target in datastage?
If you want to use the same piece of code in different jobs, how will you achieve it?
What is datastage engine?
What are the some differences between 7.x and 8.x version of datastage?
