In other discussion someone pointed out about passing a gpu to a windows kvm[1] and getting the output back to linux[2]. I never tried but seems really promising, might try it someday

[1] https://news.ycombinator.com/item?id=22905390#22906984

[2] https://looking-glass.hostfission.com