i want send my all duplicate record one tar and all uniq
records one target how we will perfome explain
example:
input data
eid
251
251
456
456
951
985
out put/target1
251
251
456
456
out put/target2
951
985
how we will bring
Answers were Sorted based on User's Feedback
Answer / anil
Hi,
This can be do easily with loops in transformer stage
Design
--------
Sq File - > Aggregrate - > Transformer - > Unique
|
Duplicate
1. In aggregate, calculate no of rows say counts
2. In transformer , define a stage variable stgTest whose derivation is if counts > 1 then 'Duplicate' Else 'Single'
3. In the loop condition define @iteration < Counts
4. Take a loop variable saying lopNumbers = EID
5. Now for Unique link write constraint as stgTest = 'Single' and output derivation of EID = @iteration.
6. Now for Duplicate link write constraint as stgTest = 'Duplicate' and output derivation of EID = @iteration.
7. Now you will get duplicate values in one link and unique values in another link.
| Is This Answer Correct ? | 0 Yes | 1 No |
Answer / sreenu
Using aggregation and filter stage,
In aggregation stage we calculate the count of incoming
records and in filter we use count<>1 for output1, count=1 for
output2...
| Is This Answer Correct ? | 1 Yes | 4 No |
Answer / vsandu
just sort the data ,and bring key changevalues by using
sort ,
in transformer write a logic if group id is 1,0 then target
1 else if group id is anly 1 then target2
as per my knowledge ,if any mistake correct me
| Is This Answer Correct ? | 1 Yes | 6 No |
Highlight the main features of datastage?
What are the different kinds of views available in a datastage director?
Define repository tables in datastage?
if we take 2 tables(like emp and dept), we use join stage and how to improve the performance?
Is it possible to query a hash file?
INPUT file 'A' contains: 1 2 3 4 5 6 7 8 9 10 input file 'B' contains: 6 7 8 9 10 11 12 13 14 15 Output file 'X' contains: 1 2 3 4 5 Output file 'Y' contains: 6 7 8 9 10 Output file 'Z' contains: 11 12 13 14 15 How can we implement this in a single ds job?
what is the function in Transformer stage can act as Rank function in Oracle
how can we create a Sorrogate key in transformer stage? I want it in parallel mode
What is orabulk stage?
Differentiate between data file and descriptor file?
which unix commands mostly used in datastage
How to convert alpha Numeric values to alpha using functions?