I am not certain how you have managed to come to such a conclusion. Thermal conductivity of air is around 0.03W/(m·K)[0]. Good thermal, non-conductive paste is like 12.5W/(m·K)[1] (or 400 times better than air). Conductive ones are in the region of ~40-80 W/(m·K) and Aluminium is 237W/(m·K). Also air also expands pushing the cooler and CPU away.
Normally you if choose between "too much" and "too little" paste, you pick the former. The pressure pushes out the unneeded amounts.
[0]: https://www.engineeringtoolbox.com/thermal-conductivity-d_42... [1]: http://www.thermal-grizzly.com/en/products/16-kryonaut-en
I would be extremely surprised if increased pressure due to air at higher temperature played any role whatsoever unless the bolts connecting the heatsink and cpu were very loose. If anything, I'd expect the increased conductivity of air at higher temperatures to dominate.
I'd also expect there to be effects at the metal-paste and paste-metal interfaces which reduce the effective system conductivity (i.e. phonons are much more likely to reflect in this scenario than in a metal-metal interface).
A fun thing to try is using a modern low-end CPU (latest i3s, Pentiums, Celerons) without its cooler. Not advised by Intel, of course, but you might get into your OS of choice even before it starts throttling. I'm somewhat comforted by the fact that a CPU automatically powers of once it reaches something above 100 C (103 maybe?) and throttles a few degrees before that. Those temperatures shouldn't leave the silicon damaged.
In practice, thermal paste is a must. If you don't like those (I personally don't, they get everywhere by accident and can be tough to remove), try getting an IC Graphite Thermal Pad which is reusable and rivals really good, if not the best thermals pastes, according to the limited number of reviews I've seen. I think that its practicality beats better results in non-highest-end applications.
Metal is an incredibly good conductor on its own, and the properties of thermal paste (typically) are just barely better than air. So long as your cpu and heatsink are fairly flat surfaces and mashed together physically, it seems like either forgoing or having the absolute minimum amount of paste is ideal. I've used a razor to leave an absolutely minimal layer of paste (e.g. filling in sub-millimeter surface structure) on my latest build, and cpu temperatures are well within a reasonable range. But I'm also not trying to OC the cpu or anything.
Thoughts?