News for hackers. Stuff that matters.
Re:What you need may be “pipeline +Unix commands” only by hedora on Sunday March 03, 2019 @11:21PM (#19298754)
Before reaching for spark, etc:

Sort is good for aggregations that fit on disk (TBs these days, I guess)

Perl does well too if the output fits in a hashtable in DRAM, so 10’s (or maybe 100’s?) of GBs

There are no comments on this comment yet.