News for hackers. Stuff that matters.
Re:Databricks response to Snowflake's accusation of lacking ... by avip on Monday November 15, 2021 @04:03PM (#29232720)
I've used both products in production. Both are good++.

The blog wars seem extremely ridiculous to me. I don't recall ever choosing one over another based on how fast it runs on some imaginary arbitrary dataset.

Re:Databricks response to Snowflake's accusation of lacking ... by paxys on Monday November 15, 2021 @04:09PM (#29232792)
Manufactured rivalries can be a great thing for business. We have been debating Coke vs Pepsi, Nike vs Reebok, McDonald's vs Burger King for decades now while these companies laugh all the way to the bank.
Re:Databricks response to Snowflake's accusation of lacking ... by javajosh on Monday November 15, 2021 @04:40PM (#29233149)
Like the post but I would add "Ford v Ferrari" there. A synthetic 100T test is much like an F1 course - not something you deal with during your commute, but it's nice to know what the limit is, and that there are people pushing that limit.
Re:Databricks response to Snowflake's accusation of lacking ... by kartoonhero on Monday November 15, 2021 @04:30PM (#29233034)
Its not ridiculous at all. This is the coming of age for a brand new data architecture.

One of the biggest FUDs for a data lake architecture is performance - and this benchmark should put that concern to rest.

Re:Databricks response to Snowflake's accusation of lacking ... by buttaphingas on Tuesday November 16, 2021 @12:41AM (#29237288)
I actually see them as variations on the same architecture. Databricks keeps their metadata in files, Snowflake keeps theirs in a database, but they both, ultimately, are querying data stored in a columnar format on blob store (and, to be fair, Snowflake have been doing that with ACID-compliant SQL for a lot longer than Databricks). So using SQL over blob at high performance has been around for a while.

Databricks say their solution is better because it's open (though keep the optimizations you need to run this at scale to themselves, i.e. is ultimately proprietary). Snowflake says theirs is better because it's a fully managed service, meaning no infrastructure to procure or manage, is fully HA across multiple data centers by default etc.

Databricks push 'open' but really still want you to use their proprietary tech for first transforming into something usable (Parquet/Delta) and then querying with Photon/SQL, though you can also use other tech. With Snowflake you can just ingest and query, but it has to be through their engine.

Customers should do their own valudation and see which one fits their needs best.

Re:Databricks response to Snowflake's accusation of lacking ... by syntaxfree on Monday November 15, 2021 @08:59PM (#29235757)
I don’t know, “coming of age” seems to imply that there’s some pre-maturity period out of which something is emerging.
Re:Databricks response to Snowflake's accusation of lacking ... by CactusOnFire on Tuesday November 16, 2021 @12:03AM (#29237060)
It was inevitable.

Both Databricks and Snowflake have inflated marketing budgets, and marketing feels they have to "beat" the other one or they'll lose the market.