blog.up-link.ro
4Aug/100

Tip of the day: How to remove duplicate entries in a file without sorting

GNU awk is a programming language that is designed for processing text-based data, either in files or data streams, and was created in the 1970s at Bell Labs.

To remove duplicate entries without sorting them, enter:

gawk '!x[$0]++' filename
Print This Post Print This Post
No Comments
   

Subscribe



Calendar

August 2010
M T W T F S S
 1
2345678
9101112131415
16171819202122
23242526272829
3031  

Polls

What's your favorite operating system?

View Results

Loading ... Loading ...

Quote of the day

To put the world right in order, we must first put the nation in order; to put the nation in order, we must first put the family in order; to put the family in order, we must first cultivate our personal life; we must first set our hearts right.
- Confucius -
My Quote, by Xhanch

Recent Posts

Recent Comments

Blogs

Links

Archives

Tags

apache bash boot bridge bsd centos debian fedora freebsd google howto ifconfig install linux make monitoring mount mysql mysql-server network openbsd openssh password recovery pf pf.conf php.ini php5 ports rhel samba security server ssh sysadmin tips tips & tricks tools tutorial tweaking ubuntu unix update upgrade virtualization vulnerabilities