How can remove duplicates in a file using UNIX?
Answer Posted / vishwababu
You can use UNIQ to remove duplicates frm a file but it can
consider only same consecutive records.
Ex: if u hve records as
1 vishwa
1 Shruti
2 Ravi
3 Naveen
1 vishwa
and if u use UNIQ cmd, then you wil get vishwa, Ravi, Naveen
and vishwa.
So perform sort before using UNIQ so tat to avoid duplicates
| Is This Answer Correct ? | 7 Yes | 7 No |
Post New Answer View All Answers
What are the various kinds of containers available in datastage?
Distinguish between informatica & datastage. Which one would you choose and why?
Explain Quality stage?
What is the difference between account and directory options ?
table actions available in oracle connector?
What is the differentiate between data file and descriptor file?
How do you import and export the datastage jobs?
Whats difference betweeen operational data stage (ods) and data warehouse?
What is datastage engine?
What are the different kinds of views available in a datastage director?
Can you implement SCD2 using join, transformer and funnel stage?
Differentiate between datastage and informatica?
what are the devoleper roles in real time? plz tell i am new to datastage....
What are the components of datastage?
What is the method of removing duplicates, without the remove duplicate stage?