This has been a consistent problem for me as well; Nix is way too concerned about purity. I think it comes from a desire to make package installation fast by using prebuilt binaries. I personally could give or take the prebuilt binary concept; nice to have but I'm willing to pay the time cost to be able to run things on non-NixOS systems.