i want send my all duplicate record one tar and all uniq
records one target how we will perfome explain
example:
input data
eid
251
251
456
456
951
985
out put/target1
251
251
456
456
out put/target2
951
985
how we will bring
Answer Posted / anil
Hi,
This can be do easily with loops in transformer stage
Design
--------
Sq File - > Aggregrate - > Transformer - > Unique
|
Duplicate
1. In aggregate, calculate no of rows say counts
2. In transformer , define a stage variable stgTest whose derivation is if counts > 1 then 'Duplicate' Else 'Single'
3. In the loop condition define @iteration < Counts
4. Take a loop variable saying lopNumbers = EID
5. Now for Unique link write constraint as stgTest = 'Single' and output derivation of EID = @iteration.
6. Now for Duplicate link write constraint as stgTest = 'Duplicate' and output derivation of EID = @iteration.
7. Now you will get duplicate values in one link and unique values in another link.
| Is This Answer Correct ? | 0 Yes | 1 No |
Post New Answer View All Answers
How do you register plug-ins?
Explain Quality stage?
how to implement scd2 in datastage 7.5 with lookup stage
What are the processing stages?
tell me 5 situations when we r using oracle db stages like orecle connector, oracle enterprise
How rejected rows are managed in datastage?
What is difference between server jobs & parallel jobs?
Define Data Stage?
What is ibm datastage?
Define Merge?
Is it possible to query a hash file?
How to Remove Duplicate using SQL?
Why do we use link partitioner and link collector in datastage?
what is ds administrator used for?
What is meta stage?