Command-line Tools can be 235x Faster than your Hadoop Cluster (2014)

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by StreamBright on Tuesday March 08, 2022 @02:51AM (#30597518)

> Outside of legacy systems, Hadoop isn't widely used anymore.

This is not true at all. Almost all the cloud providers have their own Hadoop distributions that is used a lot in many companies.

[ Parent | on HN ]

Re:Command-line Tools can be 235x Faster than your Hadoop Cl... by rizkeyz on Tuesday March 08, 2022 @05:08AM (#30598324)

Exactly. Basically most big data lives in hdfs and hdfs is part of hadoop. Even if you use Spark and Flink I would classify that as using Hadoop (under the hood).

> However, a very common setup is to use Flink to analyze data stored in the Hadoop Distributed File System (HDFS). -- https://wints.github.io/flink-web//faq.html

[ Parent | on HN ]