News for hackers. Stuff that matters.
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by mythz on Wednesday June 04, 2025 @06:32AM (#44179228)
The pricing doesn't look that compelling, here are the hourly rate comparisons vs runpod.io (what I use):

    1x L4 24GB: Google: $0.71, Run Pod: $0.43, spot: $0.22
    4x L4 24GB: Google: $4.00, Run Pod: $1.72, spot: $0.88
    1x A100 80GB: Google: $5.07, Run Pod: $1.64, spot: $0.82
    1x H100 80GB: Google: $11.06, Run Pod: $2.79, spot: $1.65
    8x H200 141GB: Google: $88.08, Run Pod: $31.92
Google's pricing also assumes you're running it 24/7 for an entire month, where as this is just the hourly price for Run pod. Also couldn't find Google's spot pricing for GPUs.
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by ZiiS on Wednesday June 04, 2025 @06:53AM (#44179335)
I think the Google prices are billed per-second so under 20min you are better on Google?
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by mythz on Wednesday June 04, 2025 @07:31AM (#44179539)
RunPod also charges per second [1], also this is Google's expected avg cost per hour after running it 24/7 for an entire month, I couldn't find an hourly cost for each GPU.

Also when you need under <1hr than you can go with Runpod's Spot pricing which is ~4-7x cheaper than Google, where even 20min of Google would cost more than 1hr on RunPod.

[1] https://docs.runpod.io/serverless/pricing

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by thousand_nights on Wednesday June 04, 2025 @07:14AM (#44179442)
runpod is billed by the minute
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by bts4 on Thursday June 05, 2025 @03:55PM (#44195216)
Technically we bill Pods by the millisecond. Pennies matter :)
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by otherjason on Wednesday June 04, 2025 @10:27AM (#44181071)
Where did you get the pricing for vast.ai here? Looking at their pricing page, I don't see any 8xH200 options for less than $21.65 an hour (and most are more than that).
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by zackangelo on Wednesday June 04, 2025 @12:16PM (#44182359)
I think it’s a typo, looks pretty close to their 8xH100 prices.
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by counters on Wednesday June 04, 2025 @12:39PM (#44182625)
Nothing but 1xL4 are even offered on Cloud Run GPUs, are they?
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by steren on Wednesday June 04, 2025 @01:47PM (#44183480)
> Google's pricing also assumes you're running it 24/7 for an entire month

What makes you think that?

Cloud Run [pricing page](https://cloud.google.com/run/pricing) explicitly says : "charge you only for the resources you use, rounded up to the nearest 100 millisecond"

Also, Cloud Run's [autoscalling](https://cloud.google.com/run/docs/about-instance-autoscaling) is in effect, scaling down idle instances after a maximum of 15 minutes.

(Cloud Run PM)

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by mythz on Thursday June 05, 2025 @09:39PM (#44197129)
Because the pricing when creating an instance shows me the cost for the entire month, then works out the average hourly price based on that. This is just creating a GPU VM instance, I don't see how to see the cost of different NVidia GPUs without it.

If you wanted to show hourly pricing, you would show that first, then calculate the monthly price from the hourly rate. I've no idea if the monthly cost includes sustained usage discount and what the hourly cost is for just running it for an hour.

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by steren on Thursday June 05, 2025 @10:47PM (#44197405)
> Because the pricing when creating an instance shows me the cost for the entire month

Are you referring to the GCP pricing calculator?

> This is just creating a GPU VM instance

Maybe you are referring to the Compute Engine VM creation page? Cloud Run is a different GCP service.

The Cloud Run Service creation UI doesn't show the cost.

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by progbits on Wednesday June 04, 2025 @04:07PM (#44184935)
You can just go to "create compute instance" to see the spot pricing.

Eg GCP price for spot 1xH100 is $2.55/hr, lower with sustained use discounts. But only hobbyists pay these prices, any company is going to ask for a discount and will get it.