Nelson Pass has designed a series of innovative amplifiers that he sells as commercial products. He also releases circuit diagrams and build instructions his amplifiers, and helps out DIYers on public forums.
In contrast, it is great that NwAvGuy has designed a budget headphone amplifier, and released the design with a no derivative works allowed Creative Commons license. But that falls a long way short of what Nelson Pass has produced over the years in my opinion.
I think if you asked Nelson Pass whether or not all 'decently made' amplifiers sound the same, he would suggest you need do a bit of listening to different high quality designs.
We agree though about speakers and the quick win they represent. They're like your car's tires, the primary interface between you and the medium, and an upgrade is the lowest hanging fruit.
Your car example is perfect. If performance was the only metric the buyer of a Pagani cared about, he'd have bought a ZR-1 Corvette. But because anyone with a six figure income and a 730+ FICO can buy a Vette, the gazillionaire buys the Pagani, something that exists (in part) because it projects the buying capability of it's owner.