I didn't say it was faster, and I didn't say the majority needed to do it.

The reason is to be able to customize your build and/or apply patches. Tom Lane fixed a production bug I reported in hours and this got me running fairly quickly.