News for hackers. Stuff that matters.
Re:Ask HN: Sorting massive text files? by secretasiandan on Saturday August 14, 2010 @12:20PM (#1603514)
I've never used it but there's a -S flag for sort that allows you to specify buffer size. So maybe look into increasing that as large as you can.
Re:Ask HN: Sorting massive text files? by sqrt17 on Saturday August 14, 2010 @02:17PM (#1603743)
-S is quite useful. For bigger sorting tasks, I usually use -S50% to speed up the speed of sorting. (sort's default memory size must be about 1MB).

It may also help to use compression with the temporary files (something like "--compress-program lzop"), but I've never tried that.