Interested to Buy Any Domain ? << Click Here >> for more details...
Drop duplicate records ...
SOURCE LIKE ..........
ID flag1 flag2
100 N Y
100 N N
100 Y N
101 Y Y
101 N Y
102 Y N
103 N N
104 Y Y
105 N N
106 N Y
102 N Y
105 Y Y
in above file if any id having both the flags as "N" then
that corresponding id records should be dropped,
in above case o/p should be as
ID flag1 flag2
101 Y Y
101 N Y
102 Y N
102 N Y
104 Y Y
106 N Y
Steps to do :
1) Identified the id’s that got duplicated (both the
flag values having vales “N”)
2) Look up with these id’s to existing id’s to drop .
- 2 Answers
- 5590 Views
- I also Faced
- E-Mail Answers
Answer Posted / vz
Put a constraint in Transformer stage as shown bellow.
flag1=y or flag2=y
means
feald1=y or feald2=y
I think it's help you.
| Is This Answer Correct ? | 3 Yes | 1 No |
Post New Answer View All Answers
If we take 2 tables(like emp and dept),we use join stage and how to improve the performance?
How can one find bugs in job sequence?
How can we improve the performance in datastage?
What are the types of containers and how to create them?
How do u convert the columns to rows in datastage?
What is a folder? Difference types of stages?
project Steps,hits, Project level HArd things,Solved methods?
How do you remove duplicate values in datastage?
how to add a new records into source?
What is usage analysis in datastage?
On which interface you will be working as a developer?
What are the different options associated with dsjob command?
What are the job parameters?
Difference between server jobs & parallel jobs?
What is the difference between odbc and drs stage?
