(Though I don't really disagree that it's generally easier to swap out parts on a (home-built) tower computer than it is with most things because of standards.)
But again to the basic point, it's certainly close to a wash which wouldn't be true with most things.
Not sure about laptops though.
ADDED: I suspect people who say that it's cheaper to build your own PC are mostly thinking in terms of it can certainly be cheaper to upgrade a DIY system than to buy a new one off the shelf.
Of course the big question is, why aren't household devices/appliances using standardized and interchangeable components? In many cases, it could probably be done. I suspect the main differentiator is consumer expectation. A significant number of consumers of bikes and desktop computers will repair, upgrade, and accessorize their purchase. Very few people will expect to do the same with their blender or television.
You won't see too many industries attempting this kind of standardization anytime soon.