Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by seabrookmx on Wednesday June 04, 2025 @11:21AM
(#44181706)
You're thinking of gvisor. But no, the "gen2" runtime is a microvm ala firecracker and performs a lot better as a result.
Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by JoshTriplett on Wednesday June 04, 2025 @12:20PM
(#44182409)
Ah, that's great.
And it looks like Cloud Run can do something Lambda can't: https://cloud.google.com/run/docs/create-jobs . "Unlike a Cloud Run service, which listens for and serves requests, a Cloud Run job only runs its tasks and exits when finished. A job does not listen for or serve requests."
Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by pryz on Wednesday June 04, 2025 @12:33PM
(#44182550)
https://github.com/cloud-hypervisor/cloud-hypervisor or something else?
Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by seabrookmx on Thursday June 05, 2025 @11:35AM
(#44192695)
Possibly? I haven't found any public documentation that says specifically what hypervisor is used.
Google built crosvm which was the initial inspiration for firecracker, but Cloud Run runs on top of Borg (this fact is publicly documented). Borg is closed source, so it's possible the specific hypervisor they're using is as well.
Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by yencabulator on Friday June 06, 2025 @03:23PM
(#44204108)
I believe that's an Intel project, not a Google project. I personally think it's more likely Cloud Run is on top of the same proprietary KVM-based code they use for their Compute Engine.
Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by rpei on Wednesday June 04, 2025 @03:36PM
(#44184658)
We (I work on Cloud Run) are working on root access. If you'd like to know more you can reach me [email protected]
Re:Cloud Run GPUs, now GA, makes running AI workloads easier...
by JoshTriplett on Wednesday June 04, 2025 @04:10PM
(#44184955)
Awesome! I'll reach out to you, thank you.
Does Cloud Run give you root?