one file contains
col1
100
200
300
400
500
100
300
600
300
from this i want to retrive the only duplicate like this
tr1
100
100
300
300
300 how it's possible in datastage?can any one plz explain
clearley..........?
Answer Posted / reddymkl.dwh
Job Design:
Agg--->Filter1---------->|
| | Unique
file-->cp-------------------->Join---->Filter2---->target1
|
|-->Duplicate
Target2
Agg: use aggregator and select Agg_type=count rows and then give the Count O/P column=Cnt (User defined).
Filter1: give the condition Where=Cnt=1
U will get unique values like 200,400,500,600
Use Join (Or) Lookup stage: select left outer join
Filter2:
Where=Column_name='' (Duplicate values like 100,100,300,300,300)
Where=Column_name<>'' (Unique Values like 200,400,500,600)
u will get the right output....what ever the duplicate records.
Plz correct me if am wrong.....
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers
How can we perform the 2nd time extraction of client database without accepting the data which is already loaded in first time extraction?
How to clean the datastage repository?
What is the process of killing a job in datastage?
What is ds designer?
How can we improve performance of data stage jobs?
Is the value of staging variable stored temporarily or permanently?
What is the difference between the local container and shared container?
What is the differentiate between data file and descriptor file?
How do you remove duplicate values in datastage?
What are the partitioning techniques available in link partitioner?
What is the purpose of pivot stage and types of containers in datastage
What is the difference between in process and inter process?
How to create a file using vi editor? 2)how to delete a file in vi editor? 3)How to connect the server datastage to unix? what r the command lines we r using? 4)30 jobs r runnig in unix i want to find out my job. how to do this? give me command?
To see hidden files in LINIX?
Field,NVL,INDEX,REPLACE,TRANSLATE,COLESC