Re:Post-mortem of March 12 Google outage
by shereadsthenews on Thursday March 14, 2019 @07:11PM
(#19394826)
As long as we're splitting hairs, only the Colossus curator can really delete the file and if the quota manager is behind you can still run out of space.
Re:Post-mortem of March 12 Google outage
by londons_explore on Thursday March 14, 2019 @08:27PM
(#19395285)
The quota manager can be behind in the opposite direction and let you go way over quota too. Yay - free unlimited disk space for all! (for ~5 minutes!)
I remember one incident where a team got an alert that they were at 90% of quota or so. They compacted data too aggressively and they actually hit 100% before the GC could do its job. That's why I mentioned that you should compact a fraction of the table, then let GC run. Google being Google, I'm sure such a tool has been written, in several variants, by N different teams.