News for hackers. Stuff that matters.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by pram on Monday June 26, 2023 @10:41AM (#36480233)
The biggest difference to consider is storage, I guess. Databricks clusters can store in S3 or wherever you want really. Snowflake has their own storage layer and it always lives in their cloud. This precludes any on-prem deployments.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by ramraj07 on Monday June 26, 2023 @10:51AM (#36480337)
You can’t be more wrong? Snowflake also stores in s3 or elsewhere, in fact it’s like the only common feature. Snowflake uses proprietary formats mostly though and only gives a sql interface. Think of it as Apple vs android.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by cfeduke on Monday June 26, 2023 @11:29AM (#36480999)
> You can’t be more wrong? Snowflake also stores in s3 or elsewhere

Snowflake stores data in S3 in Snowflake's various AWS accounts. Egress fees are necessary when performing anything outside of Snowflake.

Databricks operates on data stored in your S3 on your AWS account(s). Databricks also runs on your compute contained within your AWS account(s).

Both approaches have valid use cases.

Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by chrisjc on Monday June 26, 2023 @12:56PM (#36482415)
> Snowflake stores data in S3 in Snowflake's various AWS accounts. Egress fees are necessary when performing anything outside of Snowflake.

Egress fees are only if you are unloading into a different region/cloud. If your data is in SF AWS us-east-1, and you unload to your S3 in us-east-1, there is no egress fee.

> Snowflake charges a per-byte fee for data egress when users transfer data from a Snowflake account into a different region on the same cloud platform or into a completely different cloud platform. Data transfers within the same region are free.

https://docs.snowflake.com/en/user-guide/cost-understanding-...

Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by pram on Monday June 26, 2023 @11:38AM (#36481163)
Not in your account.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by jrott on Monday June 26, 2023 @12:10PM (#36481669)
The compute itself can be in your account. The control plane is usually managed by databricks
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by jamesblonde on Monday June 26, 2023 @10:55AM (#36480395)
Databricks are not on-premises either.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by cfeduke on Monday June 26, 2023 @11:27AM (#36480951)
> Databricks are not on-premises either.

Usually, no. But in some cases, yes.

Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by jamesblonde on Monday June 26, 2023 @12:35PM (#36482063)
I must have missed the product announcement. Do you have a link, because everywhere I look I can't find it.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by forrest2 on Monday June 26, 2023 @02:59PM (#36484219)
You can get most products on prem at a certain price & size. A lot of companies will apply resistance though unless the contract size is right b/c on-prem contracts tend to be less unit-profitable, risky, + unique annoying terms or constraints.

If you * need * it, you find a human to talk to (sales or connect from your network).