You must be lucky and/or careful. I've gone through a bunch, and aside from losing them, it's always the headphone jack input that goes. Apparently this was common enough there were soldering how-to videos out there.

One of the things I valued most is being able to navigate the device without looking at it - not possible with the move to touchscreen interfaces most things have moved to.