News for hackers. Stuff that matters.
Re:Google Cloud Rapid Storage by akshayshah on Thursday April 10, 2025 @01:22PM (#43646109)
Very cool! This makes Google the only major cloud that has low-latency single-zone object storage, standard regional object storage, and transparently-replicated dual-region object storage - all with the same API.

For infra systems, this is great: code against the GCS API, and let the user choose the cost/latency/durability tradeoffs that make sense for their use case.

Re:Google Cloud Rapid Storage by korkybuchek on Thursday April 10, 2025 @01:39PM (#43646282)
> This makes Google the only major cloud that has low-latency single-zone object storage, standard regional object storage,

Absurd claim. S3 Express launched last year.

Re:Google Cloud Rapid Storage by akshayshah on Thursday April 10, 2025 @01:49PM (#43646378)
Sure, but AFAIK S3’s multi-region capabilities are quite far behind GCS’s.

S3 offers some multi-region replication facilities, but as far as I’ve seen they all come at the cost of inconsistent reads - which greatly complicates application code. GCS dual-region buckets offer strongly consistent metadata reads across multiple regions, transparently fetch data from the source region where necessary, and offer clear SLAs for replication. I don’t think the S3 offerings are comparable. But maybe I’m wrong - I’d love more competition here!

https://cloud.google.com/blog/products/storage-data-transfer...

Re:Google Cloud Rapid Storage by korkybuchek on Thursday April 10, 2025 @02:53PM (#43647003)
> Sure, but AFAIK S3’s multi-region capabilities are quite far behind GCS’s.

Entirely different claim.

Re:Google Cloud Rapid Storage by akshayshah on Thursday April 10, 2025 @03:15PM (#43647161)
I claimed that Google is the only major cloud provider with all three of:

- single-zone object storage buckets

- regional object storage buckets

- transparently replicated, dual region object storage buckets

I agree that AWS has two of the three. AFAIK AWS does not have multi-region buckets - the closest they have is canned replication between single-region buckets.

Re:Google Cloud Rapid Storage by whatreason on Friday April 11, 2025 @03:36PM (#43657627)
not quite the same, but S3 does have https://aws.amazon.com/s3/features/multi-region-access-point..., which would let you treat multiple buckets in different regions as one single bucket (mostly). But you still do need to set up canned replication.
Re:Google Cloud Rapid Storage by thayne on Thursday April 10, 2025 @03:21PM (#43647203)
S3 doesn't have "transparently-replicated dual-region object storage", which was part of the claim.

S3 does have replication, but it is far from transparent and frought with gotchas.

And it certainly doesn't have all of that with a single API.

Re:Google Cloud Rapid Storage by grantwu on Thursday April 10, 2025 @02:05PM (#43646538)
Isn't S3 Express not the same API? You have to use a "directory bucket" which isn't an object store anymore, as it has actual directories.

To be honest I'm not actually sure how different the API is. I've never used it. I just frequently trip over the existence of parallel APIs for directory buckets (when I'm doing something niche, mostly; I think GetObject/PutObject are the same.)

Re:Google Cloud Rapid Storage by dastbe on Thursday April 10, 2025 @01:34PM (#43646229)
Re:Google Cloud Rapid Storage by akshayshah on Thursday April 10, 2025 @01:54PM (#43646442)
The cross-region replication I’ve seen for S3 (including the link you’ve provided) is fundamentally different from a dual-region GCS bucket. AWS is providing a way to automatically copy objects between distinct buckets, while GCS is providing a single bucket that spans multiple regions.

It’s much, much easier to code against a dual-region GCS bucket because the bucket namespace and object metadata are strongly consistent across regions.

Re:Google Cloud Rapid Storage by jeffbee on Thursday April 10, 2025 @02:11PM (#43646604)
The semantics they are offering are very different from S3. In Colossus a writer can make a durable 1-byte append and other observers are able to reason about the commit point. S3 does not offer this property.
Re:Google Cloud Rapid Storage by dastbe on Thursday April 10, 2025 @04:01PM (#43647542)
Sure, but that's not what the parent said.