The overhead of VMs, properly provisioned, is minimal these days. Even going with card passthrough just works.

That doesn’t work if you have one GPU (unless you shut down the Linux desktop which defeats the point)

You need a whole damn extra card for passthrough. With the price of today’s high end cards, that option seems… less than attractive.

Single GPU passthrough: https://github.com/joeknock90/Single-GPU-Passthrough

Let alone trying to fit 2 3-slot GPUs in your machine, or have enough PCIe lanes to take advantage of them

For what?