News for hackers. Stuff that matters.
Re:Ask HN: Sorting massive text files? by JoachimSchipper on Saturday August 14, 2010 @01:00PM (#1603594)
Your example suggests that you are unhappy with the time it takes to read data from disk (the above is clearly I/O-bound). There are a zillion ways to get unique records from the file - the frequently-mentioned sort -u is one - but there's no way to do it without reading all of the file...

There are no comments on this comment yet.