Re:S3 Strong Consistency
by WrtCdEvrydy on Tuesday December 01, 2020 @07:51PM
(#25272057)
Yeah, I got seconds but people were saying there were minutes of data... max I ever saw was 3 seconds on a 2gb file...
[ Parent
| on HN ]
I ran across issues where files that we PUT in S3 were still not visible in Hive 6+ hours later. It only happened a few times out of hundreds of jobs per day for jobs running daily the last 2-3 years, but it was annoying to deal with when it happened because there wasn't a lot we could do beyond open tickets with AWS.