One notable exception recently (though it may have technical reasons) is the old Apple TV not getting Netflix where the new one did. People expected better of Apple, and thus complained bitterly.
EDIT: He also mentions that the other manufacturers offer an overwhelming number of barely-differentiated products, which you have to read about in-depth in order to decide what's really right for you. Paralysis of choice is a very bad thing for a lot of people, especially for non-experts.
It's paralyzing for experts, too. The fact that I can properly evaluate the options makes it incredibly hard to actually decide. It's much easier when I can get by with ignorance.
I'm the sort that cares about making the right choice the first time with expensive stuff, though, so when it comes to a field I know nothing about, I generally need to become knowledgeable in it first before I'll make a decision. Simpler when there's a more limited range of choices and they're all pretty good.
The iPhone 3G was released in July of 2008, I will have gotten software updates with new features, bug fixes and other stuff for almost 3 years. Owners of Samsung Android phones are not getting the latest and greatest (not yet at least).
Also, Microsoft has shot themselves in the foot multiple times. Plays-for-Sure and some of their other music initiatives have not been compatible with each other, especially the Zune. Why would I go with Microsoft if within the next couple of years that I own the device they could suddenly close down a music store or deprecate a certain music format thereby making my device instantly unusable. Apple has proven since the first iPod came out that if I purchase music on the iTunes store that I will be able to listen to it on any Apple device I own for years to come. That stability is important to a consumer.
When you also consider that basically none of the features of iOS 4 made it to the 3G, I think it's a pretty poor example.
If we assume your claim that Apple is guaranteed to stay in business, then we also have to accept the possibility that Apple being the dominant player in the mp3 player is what is driving the other companies out of business. In other words, the fact that people are buying Apple mp3 players instead of other brands is the only reason that Apple is guaranteed to be in business while the other companies (according to you) could go under at any moment. This seems like a feedback cycle to me, and this probably has less to do with the quality of Apple products than it does with feedback cycle itself.
tl;dr If Apple is 'guaranteed' to stay in business while others could fail at any moment, then it has more to do with a feedback cycle of people buying Apple products than it does with the quality of Apple products.
You're also not realizing that (as far as the iPhone is concerned), most people get new phones every 2 years (in the US at least) because they just pay the subsidized price when they sign a new contract.