I honestly do not think the Linux Kernel team should worry too much about the very small niche of people that insist on compiling on slow CPUs. Cross compiling exists, and 99% of Linux users run a precompiled vmlinuz binary.

On the other hand, the Rust language team should do their utmost to improve the speed of their compiler.