News for hackers. Stuff that matters.

A comment on Databricks response to Snowflake's accusation of lacking integrity. Parent comment

Re:Databricks response to Snowflake's accusation of lacking ... by falaki on Monday November 15, 2021 @04:50PM (#29233266)
To be fair Apache Spark, which started long before either company existed, was built on the assumption that compute and storage should be separate. Unlike Hadoop, Spark did not come with any storage system and could read from any source.
[ Parent | on HN ]
Re:Databricks response to Snowflake's accusation of lacking ... by d-d-d on Monday November 15, 2021 @05:25PM (#29233696)
> To be fair Apache Spark, which started long before either company existed

Databricks was founded before Spark 1.0 released by Spark's creators.

Hadoop was created at a time when network and disk were much slower, RAM was less abundant. Bringing compute to the data made sense, but it typically doesn't anymore.

[ Parent | on HN ]
Re:Databricks response to Snowflake's accusation of lacking ... by doppelganger1 on Monday November 22, 2021 @10:49AM (#29307656)
Hadoop was built on the notion that commodity hardware, when pooled together, can be extremely cheap and powerful. The problem is, to manage it, is a nightmare. Cloudera/HWX and others were unable to reduce the management burden and their inability to pivot to a cloud based architecture really sunk their ship.
[ Parent | on HN ]