News for hackers. Stuff that matters.

A comment on Cloud Run GPUs, now GA, makes running AI workloads easier for everyone. Parent comment

Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by weinzierl on Wednesday June 04, 2025 @09:04AM (#44180325)
I never used modal or vast.ai and from their pages it was not obvious how they solve the yolo billing issue? Are they pre-paid or do they support caps?
[ Parent | on HN ]
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by sharifhsn on Wednesday June 04, 2025 @10:57AM (#44181385)
I know vast.ai uses a prepaid credits system.
[ Parent | on HN ]
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by geodel on Wednesday June 04, 2025 @07:20PM (#44186647)
Doesn't seem vast. Seems tight-budget.ai to me :-)
[ Parent | on HN ]
Re:Cloud Run GPUs, now GA, makes running AI workloads easier... by thundergolfer on Wednesday June 04, 2025 @12:25PM (#44182468)
Engineer from Modal here: we support caps. They kick in within ~2s if your usage exceeds the configured limit.
[ Parent | on HN ]