Interested to Buy Any Domain ? << Click Here >> for more details...
How can remove duplicates in a file using UNIX?
- 3 Answers
- 12408 Views
- Cap Gemini, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / j madhava rao
$sort -u filename will sorts the data and removes the duplicates lines from the output
| Is This Answer Correct ? | 17 Yes | 1 No |
Answer / vishwababu
You can use UNIQ to remove duplicates frm a file but it can
consider only same consecutive records.
Ex: if u hve records as
1 vishwa
1 Shruti
2 Ravi
3 Naveen
1 vishwa
and if u use UNIQ cmd, then you wil get vishwa, Ravi, Naveen
and vishwa.
So perform sort before using UNIQ so tat to avoid duplicates
| Is This Answer Correct ? | 7 Yes | 7 No |
Answer / prasad
Uniq -u File_name
It will remove duplicates records.
| Is This Answer Correct ? | 0 Yes | 2 No |
Hi Gus, Can u pls tell me How can u Call the Shell Scripting/Unix Commands in Job Sequence?
Hi , Today 1000 records updated, tomorrow 500 records updated how to find that?
Scenario : I have 2 jobs say job A and Job B with parameters x and y respectively. I need to create a sequence job. If we pass parameter x then Job A should run, If we pass parameter y then Job B should run, if we dont pass any parameter then Both Job A & B should run.
What is Ad-Hoc access? What is the difference between Managed Query and Ad-Hoc access?
What are sequencers?
What are the components of datastage?
How to generate surrogate key without using surrogate key stage?
what is the exact difference between dataset and fileset in datastage?
What is difference between symmetric multiprocessing and massive parallel processing?
How to remove duplicates in transformer stage? in parallel mode
What are the benefits of datastage?
eno ename 1 qaz 1 wsx 1 edc 2 zxc 2 asd 3 qwe 3 wer 3 tru 4 rgj Output: eno ename count 1 qaz,wsx,edc 3 2 zxc,asd 2 3 qwe,wer,tru 3 4 rgj 1 I want the above output to be solved by DataStage as well and I have to write SQL query for the same output.
Teradata 
