News for hackers. Stuff that matters.
Re:Ask HN: Sorting massive text files? by nagrom on Saturday August 14, 2010 @12:13PM (#1603495)
If this is just a one off job, I would guess that running sort -u $FILE will take less time than writing some specific software for the purpose.

Of course, if you want to learn hadoop then go for it. But it's probably more practical just to let it run :-)

There are no comments on this comment yet.