Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...

How can remove duplicates in a file using UNIX?

Answer Posted / vishwababu

You can use UNIQ to remove duplicates frm a file but it can
consider only same consecutive records.
Ex: if u hve records as
1 vishwa
1 Shruti
2 Ravi
3 Naveen
1 vishwa
and if u use UNIQ cmd, then you wil get vishwa, Ravi, Naveen
and vishwa.
So perform sort before using UNIQ so tat to avoid duplicates

Is This Answer Correct ?    7 Yes 7 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Which algorithm you used for your hashfile?

1233


Demonstrate experience in maintaining quality process standards?

2638


To see hidden files in LINIX?

1589


if we using two sources having same meta data and how to check the data in two sources is same or not? and if the data is not same i want to abort the job ?how we can do this?

2285


Where do the datastage jobs get stored?

1269


What is the difference between Datastage 7.5 and 7.0?

1150


Could anyone give brief explanation bout datastage admin

2407


What is process model?

2025


AGGREGATOR default datatype

1523


What is usage analysis in datastage?

1362


What is the difference between informatica and datastage?

1303


1.new record it will insert but changes of natural key is not present in taget i want to update (here key is composite natural key )can any one help this to explan how to do

2140


In Datastage, how you can fix the truncated data error?

1201


How to read multiple files using a single datastage job if files have the same metadata?

1300


Differentiate between operational datastage (ods) and data warehouse?

1233