News for hackers. Stuff that matters.
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by freedomben on Wednesday October 25, 2017 @05:35AM (#15548687)
This is a fantastic write-up. Also I never knew this about S3:

"While it does provide read-after-write consistency for new files, it only provides eventual consistency for overwrite PUTs and for DELETEs."

Re:How we moved to Google Cloud using Consul and ZeroTier wi... by rkrzr on Wednesday October 25, 2017 @05:37AM (#15548698)
Glad you enjoyed it! I'd be happy to answer any questions about our experience.
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by bpicolo on Wednesday October 25, 2017 @11:10AM (#15550749)
> A technical problem was the lack of true strong consistency for S3

What use case made this cause an issue for you guys? My go-to resolution here is just to use immutable files (sha256'd filenames typically), though that does entail storing separate keys for every related object

Re:How we moved to Google Cloud using Consul and ZeroTier wi... by rkrzr on Wednesday October 25, 2017 @01:40PM (#15552200)
We host a lot of files and we do need permalinks to them. We also need updates to be visible immediately for everybody.
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by bpicolo on Wednesday October 25, 2017 @02:06PM (#15552500)
That's fair. Anything you don't need to resolve as redirects/file serving through an app is a big win
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by monkmartinez on Wednesday October 25, 2017 @01:55PM (#15552368)
Have you ever tested S3's eventual consistency? Just curious.
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by bpicolo on Wednesday October 25, 2017 @02:02PM (#15552446)
There's no explicit SLA, but I've heard rumor that they start getting paged at ~4 hours staleness, though that might not be actually-true. I would think it's pretty quick in the average case.
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by pchiusano on Wednesday October 25, 2017 @11:29PM (#15556149)
Random question, but did y’all purchase a different license from Zero Tier the company or is the GPL on ZT somehow not relevant for you given how it was deployed or used? (And if so can you elaborate?)
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by moduspwnens14 on Wednesday October 25, 2017 @02:24PM (#15552699)
It also only provides that read-after-write consistency for new files if you didn't already ask for that new file before writing it. Otherwise you could get a stale "no object" response.
Re:How we moved to Google Cloud using Consul and ZeroTier wi... by kgbme on Wednesday October 25, 2017 @01:07PM (#15551881)
Sorry, "S3" as in: the whole AWS (Amazon cloud) system? o.0

It's awesome... Just saying. Despite of: https://jacquesmattheij.com/the-web-in-2050

Re:How we moved to Google Cloud using Consul and ZeroTier wi... by bpicolo on Wednesday October 25, 2017 @02:04PM (#15552480)
S3 is just the simple storage service.