How can remove duplicates in a file using UNIX?
Answer Posted / vishwababu
You can use UNIQ to remove duplicates frm a file but it can
consider only same consecutive records.
Ex: if u hve records as
1 vishwa
1 Shruti
2 Ravi
3 Naveen
1 vishwa
and if u use UNIQ cmd, then you wil get vishwa, Ravi, Naveen
and vishwa.
So perform sort before using UNIQ so tat to avoid duplicates
| Is This Answer Correct ? | 7 Yes | 7 No |
Post New Answer View All Answers
Which algorithm you used for your hashfile?
Demonstrate experience in maintaining quality process standards?
To see hidden files in LINIX?
if we using two sources having same meta data and how to check the data in two sources is same or not? and if the data is not same i want to abort the job ?how we can do this?
Where do the datastage jobs get stored?
What is the difference between Datastage 7.5 and 7.0?
Could anyone give brief explanation bout datastage admin
What is process model?
AGGREGATOR default datatype
What is usage analysis in datastage?
What is the difference between informatica and datastage?
1.new record it will insert but changes of natural key is not present in taget i want to update (here key is composite natural key )can any one help this to explan how to do
In Datastage, how you can fix the truncated data error?
How to read multiple files using a single datastage job if files have the same metadata?
Differentiate between operational datastage (ods) and data warehouse?