News for hackers. Stuff that matters.
Re:Burnt $72k testing Firebase and Cloud Run and almost went... by AngusH on Thursday December 10, 2020 @01:52PM (#25376998)
But we've had disk quotas before that mostly worked?

If anything it seems an easier problem than processor time.

I recall disk quotas on shared systems at university back in 1998 and I'm sure they existed before that.

Two thresholds IIRC, one at which you get a warning, second at which you can't write any further and the disk write operation fails.

I don't think they deleted files, it was just you couldn't write more than [quota] bytes to your disk.

Is there something particular about cloud based systems that prevent this from working?

ie. is this a specific problem with distributed storage?

edit:tone

Re:Burnt $72k testing Firebase and Cloud Run and almost went... by robrtsql on Thursday December 10, 2020 @02:08PM (#25377172)
S3 costs money to keep your files in, even if you're not touching them, so just preventing further uploads wouldn't do much to prevent your AWS bill from increasing.
Re:Burnt $72k testing Firebase and Cloud Run and almost went... by camjohnson26 on Thursday December 10, 2020 @06:49PM (#25380395)
It would let you set an upper limit on the price you pay though. Better than accidentally misconfiguring a logging service and writing gigabytes of unneeded data.
Re:Burnt $72k testing Firebase and Cloud Run and almost went... by user5994461 on Saturday December 12, 2020 @02:12PM (#25400642)
>>> But we've had disk quotas before that mostly worked?

AWS has quotas on everything, including quotas on EBS storage per region.

You will realize that after you spin up some instances with disks and it's failing because you've hit 10 TB of EBS storage. Have to raise a ticket to raise the limit.

Re:Burnt $72k testing Firebase and Cloud Run and almost went... by Spooky23 on Thursday December 10, 2020 @06:54PM (#25380441)
The IaaS services are easy. Other services are more difficult. Something like BigQuery ML could generate massive bills pretty easily.