News for hackers. Stuff that matters.
Re:BigQuery prices increasing by more than 100% for many users by halotrope on Friday March 31, 2023 @11:10AM (#35388275)
What is the best alternative for BigQuery? What is the most economical? Once you are hooked, it is really hard to imagine going to e.g Redshift
Re:BigQuery prices increasing by more than 100% for many users by nycdatasci on Friday March 31, 2023 @11:22AM (#35388467)
Snowflake is easily the best alternative. It's a little expensive, but it just works.
Re:BigQuery prices increasing by more than 100% for many users by berkle4455 on Friday March 31, 2023 @11:44AM (#35388833)
Slowflake isn’t really an alternative if someone is switching due to costs. It’s generally more expensive for the same workloads.
Re:BigQuery prices increasing by more than 100% for many users by weego on Friday March 31, 2023 @11:34AM (#35388669)
I could never understand how to go about guesstimating what snowflake would cost, their pricing abstraction feels like lunacy as an outsider.
Re:BigQuery prices increasing by more than 100% for many users by bhouston on Friday March 31, 2023 @11:38AM (#35388736)
That is because they figure out what you will pay and that is what they charge. It is completely disconnected from the costs involved.
Re:BigQuery prices increasing by more than 100% for many users by disgruntledphd2 on Friday March 31, 2023 @11:37AM (#35388719)
They're the Oracle of cloud databases.

Great product, pricing models are pretty insane.

And despite the pricing, they're still losing money!

Re:BigQuery prices increasing by more than 100% for many users by HDThoreaun on Friday March 31, 2023 @12:29PM (#35389481)
Snowflake is much slower than BigQuery in my experience.
Re:BigQuery prices increasing by more than 100% for many users by CommanderHux on Friday March 31, 2023 @06:43PM (#35394760)
For which workload?
Re:BigQuery prices increasing by more than 100% for many users by HDThoreaun on Friday March 31, 2023 @07:28PM (#35395173)
My workload involves streaming around a terabyte per hour and creating cubes(varying aggs, count distinct) on that data once per hour in addition to daily, weekly, monthly. Snowflake frankly could not do it. The hourly cube took longer than an hour to finish.
Re:BigQuery prices increasing by more than 100% for many users by neeleshs on Friday March 31, 2023 @01:23PM (#35390161)
A little expensive is an understatement. It's black magic to figure out how much it's going to cost. Our test instance of snowflake costs 10x production BigQuery costs, which stores an order of magnitude more data and queries even more
Re:BigQuery prices increasing by more than 100% for many users by jread on Friday March 31, 2023 @11:18AM (#35388384)
Athena and Redshift Spectrum are the best alternatives on the AWS side.
Re:BigQuery prices increasing by more than 100% for many users by veeti on Friday March 31, 2023 @11:19AM (#35388400)
Buy the biggest server on Hetzner and install ClickHouse (/s?)
Re:BigQuery prices increasing by more than 100% for many users by re-thc on Friday March 31, 2023 @11:29AM (#35388588)
There's also ClickHouse Cloud now.
Re:BigQuery prices increasing by more than 100% for many users by hodgesrm on Friday March 31, 2023 @11:44AM (#35388835)
Even better, there are lots of ClickHouse clouds! ClickHouse Cloud, Altinity.Cloud, DoubleCloud, Aiven, TinyBird...plus many others. This is the best assurance for users that prices for ClickHouse will stay competitive over time.

Disclaimer: I work at Altinity.

Re:BigQuery prices increasing by more than 100% for many users by crop_rotation on Friday March 31, 2023 @11:15AM (#35388355)
Snowflake seems most similar, plus you would get to stay on GCP.
Re:BigQuery prices increasing by more than 100% for many users by rekttrader on Friday March 31, 2023 @11:18AM (#35388382)
Export your data via avro files and try using Athena
Re:BigQuery prices increasing by more than 100% for many users by erikcw on Friday March 31, 2023 @11:24AM (#35388511)
Ideally you’d used Parquet or ORC if querying from Athena/Trino/Presto. Since they are columnar formats you will enjoy considerably faster queues and lower query costs for most query patterns other than “select *…” since the query engine can just retrieve the columns needed for your query instead of the entire row.
Re:BigQuery prices increasing by more than 100% for many users by mateo411 on Friday March 31, 2023 @06:22PM (#35394537)
100 percent correct.

Ideally you will also partition the data, so your queries can use partitions. Athena charges $5 per terabyte of data scanned, so it's important to get this right.

Re:BigQuery prices increasing by more than 100% for many users by samtp on Friday March 31, 2023 @11:59AM (#35389068)
May be a slightly different use case but moving from BigQuery to managed Clickhouse on clickhouse.com has been pretty great. Easy data injection, super fast querying, lots of control over the environment, and a nice SQL console for quickly looking at the data.
Re:BigQuery prices increasing by more than 100% for many users by adityapatadia on Friday March 31, 2023 @01:32PM (#35390307)
We at https://www.gumlet.com use bigquery a lot, but now it seems we will have to move to click house. Can’t trust google with anything. First Kubernetes price intro, then multi region storage price increase along with inter region price introduction and now this.

I would trust AWS but not Google.