News for hackers. Stuff that matters.
Re:Why PostgreSQL High Availability Matters and How to Achie... by roncesvalles on Wednesday June 14, 2023 @01:44PM (#36329594)
Honestly, just use Spanner. It's the perfect database*. If you need to trade freshness for savings, put a cache in front of it.

If I were building a new startup in 2023, I would need a mountain of evidence against using Spanner. It's ugly that it locks you into GCP but hey an iPhone locks you into Apple's ecosystem, that's just the price you pay to get good things.

* unless you need timeseries, columnar, FTS, geospatial, graph or something special like that

Re:Why PostgreSQL High Availability Matters and How to Achie... by endisneigh on Wednesday June 14, 2023 @01:50PM (#36329703)
Spanner is ridiculously expensive. Though I get your point, it’s not like an iPhone. An iPhone is not actually that expensive compared to top end android phones.

Spanner is very expensive even compared to hosted cockroach and RDS (Aurora). That being said I’m sure if you're enterprise it's substantially cheaper.

Spanner generally is about twice the cost as cockroach which seems cheap but the gap in nominal cost only grows with usage.

The other issue is that since there’s no source to self host you also have to pay, unlike cockroach.

Generally with cockroach I’d expect one to self host all instances except a staging/pre-pod and prod. With Spanner all your instances necessarily will be hosted, which means $$.

That being all sad, Spanner is worth it if money isn’t an issue

Re:Why PostgreSQL High Availability Matters and How to Achie... by roncesvalles on Wednesday June 14, 2023 @02:53PM (#36330787)
The thing is, there is nothing else like Spanner, unless you want to trust a startup with your database, which opens up Cockroach, Yuga, and TiDB. Databases like RDS don't compare because they don't offer the same guarantees. Nothing even in AWS' and Azure's portfolios is like Spanner.

Back of napkin math I did a couple of months ago: Spanner costs about $1/month for 2 writes/second and 10 reads/second. The minimum is $88 which is 176wps and 880rps. If your startup gets more traffic than that, you have good problems. The simplified guarantee model (fully linearizable and serializable everything; automagic sharding, replication and failover) could save you costs elsewhere.

Low-value high-volume data like logs and search queries can be sent to a cheaper self-hosted timeseries/fts database.

Re:Why PostgreSQL High Availability Matters and How to Achie... by ddorian43 on Wednesday June 14, 2023 @04:13PM (#36331896)
You forgot storage costs and especially bandwidth costs and lockin costs and probably range-queries costs.
Re:Why PostgreSQL High Availability Matters and How to Achie... by hot_gril on Wednesday June 14, 2023 @01:48PM (#36329668)
I've built my own little pile of evidence against Spanner using it for several years, after previously being on Postgres. It has good potential but isn't there yet. And if you're making a startup, you're probably a long way from the scale where sharded DBs become necessary.
Re:Why PostgreSQL High Availability Matters and How to Achie... by brigadier132 on Wednesday June 14, 2023 @02:11PM (#36330074)
I hate this tired argument. If I'm building a startup I'm building it with the intention to hit scale. If I can use cockroach or yugabyte and get 90% of the benefits of postgres without significant additional cost I'm going to use it. I've been at multiple startups that have had trouble scaling their database and the cost to switch database technologies when you hit scale is massive. And worst of all, the limitations of the technology always impact product development. I don't care what cool features postgres has if I can't do online schema changes.

So yeah, I'd rather spend a few more hours picking an actual scalable technology now than spend what could be 7 figures and massively impact product development moving to scalable technology..

Re:Why PostgreSQL High Availability Matters and How to Achie... by tmpz22 on Wednesday June 14, 2023 @03:09PM (#36330997)
Different teams have different abilities. You can't really make general rules around any of this. Should you use spanner as a default selection for your company's database needs? Maybe.
Re:Why PostgreSQL High Availability Matters and How to Achie... by audioheavy on Wednesday June 14, 2023 @03:31PM (#36331327)
both good points, including the devs having different abilities and using a ready-made scalable solution. We're living in the world of having something working that you can test in a few days shrug
Re:Why PostgreSQL High Availability Matters and How to Achie... by hot_gril on Wednesday June 14, 2023 @07:14PM (#36334192)
Some general rules make sense for common use cases. Like, I'll say that a relational DBMS is generally what you want rather than a graph one. For a single-node DB, I'll always use Postgres if I have the choice.

But sharding is too use-case specific to prescribe something broadly like Spanner.

Re:Why PostgreSQL High Availability Matters and How to Achie... by hot_gril on Wednesday June 14, 2023 @03:21PM (#36331164)
> If I can use cockroach or yugabyte and get 90% of the benefits of postgres without significant additional cost I'm going to use it

That's a big "if." Idk about those two, but you sacrifice a lot using Spanner. And in the initial phases, you can't tell what your actual needs will be at scale, so you'll probably have to rework things anyway. Just using Spanner doesn't solve your scaling problems.

Re:Why PostgreSQL High Availability Matters and How to Achie... by aadvark69 on Wednesday June 14, 2023 @02:48PM (#36330712)
Spanner is great if you have unlimited money
Re:Why PostgreSQL High Availability Matters and How to Achie... by bob1029 on Wednesday June 14, 2023 @03:31PM (#36331326)
> perfect

Doesn't spanner introduce new (very unlikely) failure modes that other databases are not impacted by? The reliance on an external consistency model feels to me like a complete outsourcing of liability that warrants thorough investigation.

Hypothetically, if GPS went down for a prolonged period and/or a bug was found in the TrueTime system, what would happen to the consistency model around Spanner?

I feel like some applications and customers would much rather wait for a synchronous acknowledgement from the actual, live system. An extra 150ms when you are confirming a 6-figure wire transfer could easily be framed as a good thing in most circles.

Re:Why PostgreSQL High Availability Matters and How to Achie... by azurelake on Wednesday June 14, 2023 @08:14PM (#36334738)
There is synchronous acknowledgement. Spanner uses 2PC + paxos groups.

If there was a bug in TrueTime, you would susceptible to phantoms, which isn’t great but almost certainly not catastrophic.

I believe that’s the only isolation issue you’d hit, since spanner locks the rows involved in a transaction.

Re:Why PostgreSQL High Availability Matters and How to Achie... by roncesvalles on Thursday June 15, 2023 @12:43AM (#36336478)
Spanner offers both linearizability and serializability. They use the non-standard term "external consistency" to describe the union of those two properties.

>Doesn't spanner introduce new (very unlikely) failure modes that other databases are not impacted by?

Curious if you could go into that.