News for hackers. Stuff that matters.

A comment on S3 Strong Consistency. Parent comment

Re:S3 Strong Consistency by SpicyLemonZest on Tuesday December 01, 2020 @07:28PM (#25271895)
I've never seen the minutes long delays that you were theoretically supposed to accommodate, but second-scale delays were pretty common in my team's experience. (We're writing a lot of files though, probably hundreds or thousands per second aggregated across all our customers.)
[ Parent | on HN ]
Re:S3 Strong Consistency by WrtCdEvrydy on Tuesday December 01, 2020 @07:51PM (#25272057)
Yeah, I got seconds but people were saying there were minutes of data... max I ever saw was 3 seconds on a 2gb file...
[ Parent | on HN ]
Re:S3 Strong Consistency by gregw2 on Tuesday December 01, 2020 @09:47PM (#25272731)
I ran across issues where files that we PUT in S3 were still not visible in Hive 6+ hours later. It only happened a few times out of hundreds of jobs per day for jobs running daily the last 2-3 years, but it was annoying to deal with when it happened because there wasn't a lot we could do beyond open tickets with AWS.
[ Parent | on HN ]