How can remove duplicates in a file using UNIX?
Answers were Sorted based on User's Feedback
Answer / j madhava rao
$sort -u filename will sorts the data and removes the duplicates lines from the output
| Is This Answer Correct ? | 17 Yes | 1 No |
Answer / vishwababu
You can use UNIQ to remove duplicates frm a file but it can
consider only same consecutive records.
Ex: if u hve records as
1 vishwa
1 Shruti
2 Ravi
3 Naveen
1 vishwa
and if u use UNIQ cmd, then you wil get vishwa, Ravi, Naveen
and vishwa.
So perform sort before using UNIQ so tat to avoid duplicates
| Is This Answer Correct ? | 7 Yes | 7 No |
Answer / prasad
Uniq -u File_name
It will remove duplicates records.
| Is This Answer Correct ? | 0 Yes | 2 No |
how to abort the job its matain duplicates?
tell me abt Datastage trigger?
What a datastage macro?
What is the difference between operational data stage (ods) and data warehouse?
What is the difference between informatica and datastage?
how to get sum of sal based on dept_no and then sum of all sal irrespective of dept_no in same sql. output:- 10, 200(sum of sal for dept_no 10), 5000(sum of all sal)
What is the difference between an operational datastage and a data warehouse?
explain about completely flow of sequencers technicaly,without using example??explain about lookup,nullhandling?
what is 'reconsideration error' and how can i respond to this error and how to debug this
what is difference between migration project and integration project? can anyone explain with the example Thanks in advance
How can one find bugs in job sequence?
How to read the length of word in unix?