Cloud Run GPUs, now GA, makes running AI workloads easier for everyone

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by decimalenough on Wednesday June 04, 2025 @07:29AM (#44179523)

You can set max instances in Cloud Run, which is an effective limit on how much you'll spend.

Also, hard dollar caps are rarely if ever the right choice. App Engine used to have these, and the practical effect was that your website would completely stop working exactly when you least want it to (posted on HN etc).

It's better to set billing alerts and make the call yourself if they go off.

[ Parent | on HN ]

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by rustc on Wednesday June 04, 2025 @07:35AM (#44179571)

> Also, hard dollar caps are rarely if ever the right choice.

Depends on if you're a big business or an individual. There is absolutely no reason I would ever pay $100k for a traffic burst on my personal site or side project (like the $100k Netlify case a few months ago).

> It's better to set billing alerts and make the call yourself if they go off.

Billing alerts are not instant and neither is anyone online 24x7 monitoring the alerts.

[ Parent | on HN ]

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by brutus1213 on Wednesday June 04, 2025 @07:46AM (#44179653)

100% agreed. This can be solved with technology .. let users set a soft and hard threshold for example. Runaway costs is the problem here.

[ Parent | on HN ]

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by ipaddr on Wednesday June 04, 2025 @08:14AM (#44179891)

One bad actor / misconfiguration / attack can put you out of business. It not the safest strategy to allow unlimited liability in business or for personal projects.

[ Parent | on HN ]