Command-line Tools can be 235x Faster than your Hadoop Cluster (2014)

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by spullara on Tuesday March 08, 2022 @03:30AM (#30597814)

I mean, it isn't like Hadoop wasn't used to parse text files. Also, it is all fun and games until you need a join.

[ Parent | on HN ]

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by kragen on Tuesday March 08, 2022 @08:20AM (#30599555)

comm(1) and join(1) can do joins on text files. Make sure they're sorted in the same locale you're joining them in; LANG=C tends to be the fastest.

[ Parent | on HN ]