How to delete duplicate record in Informatica?
Answers were Sorted based on User's Feedback
Answer / suresh
if the source is database means we can delete the duplicate
records by enabling the option select distinct in source
qualifier t/r properties or by writing the following query
in source qualifier filter
delete from emp where rowid not in (select min(rowid) from
emp group by empno);
if the source is flat file means by enabling the option
distinct in sorter t/r we can delete the duplicate records
| Is This Answer Correct ? | 27 Yes | 1 No |
Answer / mayuri
Select ditinct in properties of source qualifier
transformation.
| Is This Answer Correct ? | 21 Yes | 6 No |
Answer / infa dev
Source and the target will the same table from which the
duplicate needs to be deleted from. Then use a lookup trans
on to this same table and then use an update trans with
DD_DELETE if the row is duplicate else do nothing.
| Is This Answer Correct ? | 12 Yes | 3 No |
Answer / julius caeser
Hi
There are 2 ways to do this and both of them are efficient.
Method 1: Sorter -Filter.
Send all the data to a sorter and , sort by all feilds that
u want to remove duplicacy from . note that in the
preoperties tab, select Unique .
This will select and send forward only Unique Data .
Method 2; Use an Aggregator
Use AGG Transformation and group by the keys /feilds that u
want to remove duplicacy from.
| Is This Answer Correct ? | 11 Yes | 3 No |
Answer / aswin
use aggregator and do not apply any aggregation function, it will return only last row in the group..if you dont provide any groupby and aggregate value it will return only last row..so you can aviod dups
| Is This Answer Correct ? | 0 Yes | 1 No |
Answer / mayuresh
Hi,
how to delete duplicate values from table if source and
target are same
my Question is which logic we need to apply before using
DD_DELETE option in update strategy ?
Do we require to use aggregator to group the values and if
there count > 1 then DD_DELETE
PLZ reply
| Is This Answer Correct ? | 0 Yes | 2 No |
Answer / sarvesh
create table newtable as select distinct * from original
tablename;
by doing this we can elimate the duplicate rows
| Is This Answer Correct ? | 6 Yes | 10 No |
what is data driven?
how do u move the code from development to production?
can we use mapplet as starting n ending object in mapping
Source having one lakh record and loaded into target. Then, how can i compare records will loaded in table? For example Source having Firstname,Lastname. the same Firstname,Lastname record will be loaded into Target? How can i check in Oracle?
How to display session logs based upon particular dates. If I want to display session logs for 1 week from a particular date how can I do it without using unix. ?
Hi Friends, I want lo truncate my records from target before loading current month data,but i dont have permission to truncate with truncate option if u know any other way please give your valuable input for this. Thanks Abhishek
hw to load this give the mapping? cty state o/p c1 s1 c1 c1 s2 s1 c1 s1 c1 c2 s3 s2 c3 s4 c1 c3 s2 s1 c2 s3 c3 s4 c3 s2 2 columns should be loaded to one column in target table?
What are the new features of informatica 7.1?
Workflow is long running due to long running sql query so when we refer the query plan it tells the issue is due to partition of the db table. How to handle this?
What is galaxy shema
Why update strategy and union transformations are active? Explain with examples.
Is it possible to revert a global repository to local one and why?