Look at Google's own wallet app -- it only runs on only 6 android devices. If you want to run google wallet on your Nexus S, you'll have to run a 3rd party "hacked" version of Google Wallet.
Android development and testing really isn't all that painful, and most of the new APIs you might miss are backported and available for the more prevalent Gingerbread and now ICS.
Probably games developers have it harder on Android, but for the average app it seems just about the same to me as a developer.
There is little expectation of iOS 4 support at this point, because users who purchased an iPhone in the last 4 years don't have to use it. The same is hardly true for Gingerbread. Most of the phones that shipped with that half-baked OS will have it until they're retired into a drawer somewhere.
Every developer can safely target iOS 5. With Android it is still 2.3.
I think the correct statement would be iOS has "less" fragmentation. They still have fragmentation though. Not only through the devices but also the version of iOS running on the device. It can get pretty hairy trying to maintain support for multiple iOS devices with versions of even just 4.3 and up.