Unfortunately that "hacker spirit" seems to end at "must have the source code"; the same can't be said of those customising Windows and such, who definitely didn't have the source but succeeded nonetheless.
[1] I remember someone being very surprised that I patched the binary of a FOSS application, instead of changing the source and compiling it --- the former took a few minutes, the latter would've taken far more time (to get all the dependencies, build system, etc.) and possibly introduced other unwanted changes.
Patching a binary is impressive, sure, but it's the polar opposite of sustainable. You don't have a good way to document your fix, it's dependent on one exact source tree and how the compiler was feeling that morning, and even minor changes from upstream can completely change the way a binary patch would need to work.
It's great for a one-off hack, but part of the appeal of open source for many people is how easy it is for your changes to become part of the "permanent record" of that piece of software.