News for hackers. Stuff that matters.

A comment on Command-line tools can be faster than a Hadoop cluster (2014).

Re:Command-line tools can be faster than a Hadoop cluster (2... by bobivl on Sunday September 11, 2016 @12:57PM (#12474279)
If you like to do data analyses in bash, you might also enjoy bigbash[1]. This tool generates quite performant bash one-liners from SQL Select statements that easily crunch GB of csv data.

Disclaimer: I am the main author.

[1] http://bigbash.it

[ Parent | on HN ]
Re:Command-line tools can be faster than a Hadoop cluster (2... by qwertyuiop924 on Sunday September 11, 2016 @05:34PM (#12475857)
That's pretty cool.

Do you think you can get it to support Manta? I think a lot of people in that ecosystem could benefit from it if you could. I'd help, but I don't really know Java all that well :-(.

[ Parent | on HN ]