Re:Ask HN: Sorting massive text files?
by pixelbeat on Saturday August 14, 2010 @09:39PM
(#1604402)
We've made a multicore update to GNU sort recently, so with latest from git one can just do: sort -u
That will chunk, compress, merge automatically
Also run with LC_ALL=C if that's appropriate as it will greatly speedup. Also see the -S
[ Parent
| on HN ]
There are no comments on this comment yet.