News for hackers. Stuff that matters.
Re:Why is Snowflake so expensive by twistedpair on Monday August 22, 2022 @12:38PM (#32553851)
FWIW, BigQuery tables can be configured to require a partition filter clause [0] in the SQL query, so that you cannot shoot yourself in the foot like that. Now if they'd just make an Organization Policy to let you turn it on by default for all new tables.

[0] https://cloud.google.com/bigquery/docs/querying-partitioned-...

Re:Why is Snowflake so expensive by cs702 on Monday August 22, 2022 @04:12PM (#32556574)
Yes. That's exactly the OP's point: It's up to you to remember to do the extra work necessary to avoid shooting yourself in the foot by default.
Re:Why is Snowflake so expensive by twistedpair on Monday August 22, 2022 @08:00PM (#32558883)
Depends who the "you" is; someone just getting started with Cloud, or a savvy enterprise operator?

GCP has sided with an "easy out of the box experience". For example, a new project has a "default" network with some permissive firewall rules. A savvy operator wouldn't build things this way, but for a first time user, the cloud is daunting and a JustWorks™ experience gets them moving quickly (e.g. so they can SSH into their VMs easily).

Now, once you've gotten your feet under you, and want to build a solid cloud setup, you'll add Organization Policies [1] like "Skip default network creation", and all new Projects will be completely closed off from the web by default, at the cost of all networking being more complex. Once you're ready for this, turn it on.

So, how should a SaaS database work? Should you have to learn all the intricacies of sharding, partitioning, indexing, SELECT, FROM, HAVING, FULL/INNER/OUTER JOIN, WHERE, GROUP BY, LIMIT, before you write your first query? This is a long standing yin/yang question of product UX. What user persona and UX do you design for on the experience and complexity spectrum.

[1] https://cloud.google.com/resource-manager/docs/organization-...

Re:Why is Snowflake so expensive by itsdrewmiller on Monday August 22, 2022 @08:33PM (#32559147)
So they have a system for enforcing rules but still haven't built the rule that would reduce their revenue - seems like an example in favor of the article.