In order to solve the “forward” compatibility option you could have both Specialized binaries and a generic version in (wasm) bytecode. Then you can have all the performance optimisations you care about and retain compatibility with all platforms.

Optionally you could consider a binary that on first run (&prompt?) removes the binaries irrelevant to the current host.