News for hackers. Stuff that matters.
Re:AWS cancels serverless Postgres service that scales to zero by slau on Wednesday January 10, 2024 @09:30AM (#38939337)
Reminder that AWS Aurora claims to have broken the CAP theorem. The literature doesn’t clarify whether they are consistent or available, and when you ask AWS directly, they tell you the CAP theorem isn’t relevant due to the way Aurora is built.

They claim 99.99% availability or whatever the figure is, that it’s self healing, allows up to 2 replicas to be down for write availability and 3 replicas to be down for read availability. They promise “millisecond consistency”, whatever that even means.

Some of the blogs mention that they use distributed state to extract slivers of consistency across the nodes, which is just scary stuff to hear.

I’m seeing more and more usage of Aurora due to the magical component it offers, but I can’t wrap my head around what it’s actually supposed to be, and what the failure model is, like I can with RDS PG and MySQL.

Re:AWS cancels serverless Postgres service that scales to zero by wmfiv on Wednesday January 10, 2024 @10:01AM (#38939609)
I've not seem them claim to have broken CAP. AWS is quite an academic organization I think it'd be quite unlikely for them to say something like that.

They do actually provide quite a lot of detail about Aurora storage this works. This 2019 reinvent talk gets pretty deep into the weeds.

https://www.youtube.com/watch?v=uaQEGLKtw54

https://d1.awsstatic.com/events/reinvent/2019/REPEAT_Amazon_...

Re:AWS cancels serverless Postgres service that scales to zero by belter on Wednesday January 10, 2024 @10:09AM (#38939699)
"Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases" - https://assets.amazon.science/dc/2b/4ef2b89649f9a393d37d3e04...
Re:AWS cancels serverless Postgres service that scales to zero by zokier on Wednesday January 10, 2024 @09:58AM (#38939569)
Isn't Aurora similar to Googles Spanner in this regard, giving pretty much same characteristics?

https://cloud.google.com/blog/products/databases/inside-clou...

https://news.ycombinator.com/item?id=15923507

Re:AWS cancels serverless Postgres service that scales to zero by candiddevmike on Wednesday January 10, 2024 @09:34AM (#38939375)
AWS should show us the Jepsen or GTFO
Re:AWS cancels serverless Postgres service that scales to zero by asylteltine on Wednesday January 10, 2024 @09:32AM (#38939357)
Can’t you bypass CAP if you just have a ton of compute in the background handling all of these tasks in real time? Aurora isn’t just some binary running on ec2 it’s probably 10 different things going on
Re:AWS cancels serverless Postgres service that scales to zero by slau on Wednesday January 10, 2024 @09:36AM (#38939384)
CAP is a property of any distributed system. You have to tolerate P (considering it’s distributed), so you can only be CP or AP.

CP means you can’t be available, meaning your system will stop replying to queries.

AP means you’re always available, but you could receive stale data when querying.

It’s irrelevant whether it’s a single binary running on EC2 or a billion services working in unison. It’s a property of the system.