Statistically, basically all kernel developers are working on hardware support of one form or another. They might run changes in an appropriate simulator[1] if they have it, but the community of people able to do the bulk of their work in a desktop VM is quite small.

[1] OS X support for which tends to be a pain point too, while most vendors tend to have some kind of Linux product this is still very much a windows world.