Command-line Tools can be 235x Faster than a Hadoop Cluster (2014)

Re:Command-line Tools can be 235x Faster than a Hadoop Clust... by bryanrasmussen on Thursday May 24, 2018 @04:01AM (#17141989)

I was working in a company where they brought in some consultants to do the analytics and they were going to use Hadoop, and they said straight up "We don't need it for the amount of data, but we prefer working in Hadoop"

[ Parent | on HN ]

Re:Command-line Tools can be 235x Faster than a Hadoop Clust... by onion2k on Thursday May 24, 2018 @04:21AM (#17142092)

It's far more common for your assumptions/thinking/design to be the root cause of any real problem in things you build than your choice of tech. It doesn't matter if you use the 'wrong' tech to solve a problem if the solution works effectively, and very often using something you know well means you'll solve the problem faster and better than you would with the 'right' tool. Those consultants were probably doing the right thing.

[ Parent | on HN ]

Re:Command-line Tools can be 235x Faster than a Hadoop Clust... by bryanrasmussen on Thursday May 24, 2018 @05:27AM (#17142390)

I actually don't think they had great expertise in Hadoop though, since it was quite new at the time. but maybe

[ Parent | on HN ]