How can remove duplicates in a file using UNIX?
Answer Posted / vishwababu
You can use UNIQ to remove duplicates frm a file but it can
consider only same consecutive records.
Ex: if u hve records as
1 vishwa
1 Shruti
2 Ravi
3 Naveen
1 vishwa
and if u use UNIQ cmd, then you wil get vishwa, Ravi, Naveen
and vishwa.
So perform sort before using UNIQ so tat to avoid duplicates
| Is This Answer Correct ? | 7 Yes | 7 No |
Post New Answer View All Answers
what is 'reconsideration error' and how can i respond to this error and how to debug this
What is merge stage?
How to create a file using vi editor? 2)how to delete a file in vi editor? 3)How to connect the server datastage to unix? what r the command lines we r using? 4)30 jobs r runnig in unix i want to find out my job. how to do this? give me command?
Hi, what is use of Macros,functions and Routines..? At what situation you are used. If you know the answer please explain it. Thanks.
Which algorithm you used for your hashfile?
What is difference between server jobs & parallel jobs?
How many types of stage?
How do you run datastage job from the command line?
what is the use of surogate key in datastage
What are the steps required to kill the job in Datastage?
How will you move hashed file from one location to another location?
what is ds administrator used for?
What is the difference between hashfile and sequential file?
What are sequencers?
Differentiate between operational datastage (ods) and data warehouse?