Re:GVM: A GPU Virtual Machine for IOMMU-Capable Computers
by ArcVRArthur on Wednesday July 06, 2022 @07:13AM
(#31999295)
I wrote this page over here if you'd like to read more about how vGPUs work (VFIO-Mediated Device/SR-IOV/SIOV):
https://openmdev.io/index.php/Mediated_Device_Internals
We're doing most of our work (almost all) as open source and we're trying to make sure we have good documentation too. :)
Our company website is over here if you're interested to take a look:
How do you allocate vGPU memory between a ML/AI VM, a VDI VM, and a gaming/CAD VM? All have dramatically different requirements. You also can't think of shader/GPU cores in any way similar to CPU cores. They're essentially just vector/linear algebra accelerators with little to no branch prediction, speculative execution, or anything else you'd expect.
Otherwise, you can sort of follow along here: https://openmdev.io/index.php/GPU_Support
There's an effort, but it's far from where you want, and there's no indication it will get there unless you can get all the vendors to agree on a standard at some point in the future.