News for hackers. Stuff that matters.
Re:Ask HN: Sorting massive text files? by jbl on Saturday August 14, 2010 @09:10PM (#1604353)
This is the approach that I use except that I generate a Makefile which has:

  - a target to split the input into chunks
  - targets to sort each of the split chunks
  - a target to merge the sorted chunks using "sort -m"
Then, if you are using GNU make, it's just a matter of using the -j flag to control how many chunks are sorted in parallel.

There are no comments on this comment yet.