I shouldn't have to point out the level of build in the iPhone apps gallery. Those applications are gorgeous. Better than most PC apps, I'd argue, in their compactness and elegance. Developers have an edge on the iPhone because there's an established design standard, and there's an established screen size. So they can spend as long as they need fiddling to make their app perfect within those confines. On Android, that's not possible.
To use an unnecessary metaphor, iPhone apps are haiku and Android apps are open verse. On the one hand, it's nice not to have limits, but on the other, you find it's much easier to make something beautiful when you're given set restraints with which to riff on.
In a sense all software usage is just a series of tweaks. Otherwise you'd just have a big button to push and it would 'do stuff'. If that 'stuff' just happened to be exactly what you wanted then that would be fantastic. But that isn't reality. Reality is sometimes messy and complex so sometimes you need the ability to tweak things deal with the messy and complex problems from the real world.
Phones definitely fall into the sphere of things I like to hack on. That's definitely the crux of the difference of opinions. I would agree with you when talking about, say, cars, but a computing device that I physically own is something I want access to.