This might not be an answer you like, but I find the virtualization penalty (running on proxmox [kvm]) to be acceptable. In synthetic benchmarks, the penalty is possible to measure but small (1-3% typically). Passing through a AMD graphics card and a USB port, I get a pretty good experience in using it and an excellent experience in administering it [backups/snapshots, restores, etc. are all super clean].

If I measure against "is it viable?", for me the answer is "absolutely, yes".