Furthermore I'd say that I (presumably like most emacs users) am probably closer to 45 minutes per month, or per year, on general emacs config stuff, certainly not per day. It has still made a huge difference for me in terms of convenience and just general aesthetics.

Right, it's an extension of your life right. Some people find it fulfilling to kit out there house with exactly what they think they desire. Its just a matter of processing the stuff that makes you happy while providing _internal_ development.