On the other hand, you're correct, Stocks, Weather, Calculator, etc. are completely independent, thus could be deleted without causing trouble, but I wouldn't be surprised if the decision went down to the simplest one (at least for now): no default app gets deleted, period.
If you don't like having the extra system apps, (I don't for some of them), to quote Steve Jobs on an unrelated topic: "not that big of a deal".
Yes, your Android phone has apps you probably can't uninstall, but that's a distribution decision rather than something that was forced on them by technical limitation.
Android Froyo onwards, a lot of system apps are going to be downloadable separately, just so that you dont have to wait for your service provider to build an OTA update for you.
The official Facebook and Twitter apps integrate with system contacts, for example, not because Google integrated them at the system level, but because Google provided an API to allow this with the Android 2.0 release.
One of the things that continually impresses me about Android is the fact that Google took so much care to create a clean architecture that opens up the door to a lot of cool opportunities for any application developer.
Plus, it helps Apple's branding: as long as they're not forced into separating the apps and the APIs, like Microsoft was, they won't.
They have http:// URIs, which happens to invoke Safari as the registered handler on every iPhone.
There's no reason (other than Apple policy) why that URI handler couldn't be registered as Opera or Firefox. That's how it works on other platforms.
Even on the iPhone developers can register most URIs (e.g. myuri://) to start up their own apps as long as it isn't a protected one, unless they changed that recently.
There are reasons why you wouldn't want a browser though, which at the moment you can't do.
They may in fact not be apps at all, but just part of the system, with access via the icons. They are just made to look like apps. They may have hooks that mean they can never be deleted (like new mail), but only hidden, since there code is needed.
Is it simpler to have all the "purchasing apps" together, bundled with the iPhone/iPad or to strip away more system apps? The iPad didn't ship with calculator, stocks etc. The answer might go right back to Gruber's point: the iPad itself shipped out of the OS release cycle while the Apple Store app shipped just before the new OS in part to aid with the purchasing of iPhone4. Maybe both of these will be included in iOS5 next year.
What Gruber says makes sense for apps like Mail and Safari, but Stocks and Weather feel so grandfathered in.