In the cases where you are dumping heat, I believe these devices can have the opposite problem of effectively insulating the heat source.

I think it might technically be possible to have a very conductive heat-engine. But it seems to me like most options are still less conductive than leaving them out.