News for hackers. Stuff that matters.
Re:GVM: A GPU Virtual Machine for IOMMU-Capable Computers by evol262 on Wednesday July 06, 2022 @03:20AM (#31997822)
Looking Glass is kind of the closest you'll get for a trivial "I want shared GPU virtualization on my workstation", but GPU partitioning doesn't really work that way. Outside of the baseline support in the hardware itself, which is nowhere near generic enough for "works on any GPU" (it took supervisory frameworks to even get CUDA/OpenCL/etc to a point where you can stop worrying about writing transforms from scratch and just let PyTorch abstract it a little), this model of GPU partitioning doesn't perform well.

How do you allocate vGPU memory between a ML/AI VM, a VDI VM, and a gaming/CAD VM? All have dramatically different requirements. You also can't think of shader/GPU cores in any way similar to CPU cores. They're essentially just vector/linear algebra accelerators with little to no branch prediction, speculative execution, or anything else you'd expect.

Otherwise, you can sort of follow along here: https://openmdev.io/index.php/GPU_Support

There's an effort, but it's far from where you want, and there's no indication it will get there unless you can get all the vendors to agree on a standard at some point in the future.

Re:GVM: A GPU Virtual Machine for IOMMU-Capable Computers by ArcVRArthur on Wednesday July 06, 2022 @07:13AM (#31999295)
I wrote this page over here if you'd like to read more about how vGPUs work (VFIO-Mediated Device/SR-IOV/SIOV):

https://openmdev.io/index.php/Mediated_Device_Internals

We're doing most of our work (almost all) as open source and we're trying to make sure we have good documentation too. :)

Our company website is over here if you're interested to take a look:

https://arccompute.io/