First and foremost is the lack of background services. I'm an avid Rdio (http://rdio.com/) user, and while the app works well, it can't play in the background. Want to listen to it and check a text message? Sorry, no dice. I'm assuming this is coming with multitasking in Mango, but we'll see.
While the browser works damn well (really, why can't IE on the desktop not suck, if they can pull this off?), there are a few things that irritate me. There are two big ones: wide comments on HN (e.g. in a code block) completely break the zooming of the page, so you have to scroll back and forth to read any comment; if you're on, say, a HN thread, then go check an email and come back by clicking the IE tile rather than hitting the back button, hitting the back button then brings you back to the home screen, with no way of actually going to the previous page (history seems to only exist in the back button functionality).
And since my only test hardware has been the HD7, I should point out that it likes to reboot. A lot. I think this is related to the poor microSD slot, which allows the card to slip out and cause things to not be accessible and causes crashes -- unfortunately, it's behind a warranty-voiding-seal panel, and if it comes out for good, you're SOL. This happened to my first HD7 about a week after I got it, but thankfully hasn't happened to that extent yet.
Outside of these things, I really haven't looked back since switching from Android. The interface is beautiful and intuitive, the apps are damn fast, and overall I'm very happy with it.
I find my Windows Phone (LG Optimus) is more stable than the iPhone too. Overall I think Windows Phone 7 is really solid OS. It gets all the basic functionality right and is often better than iOS. However it does lacks the polish and apps that make iOS great.
Regarding iPhones - really? Well I went from a 3GS to a 4, the screen is a world of difference in terms of contrast ratio, battery life is better, reception is better, multitasking works better and the camera too.
And I've also had the same experience with the iPad to iPad 2 - I've been able to switch back and forth friction free.
It's really down to how you use the device, and I discovered that my use cases don't highlight the improvements. Note that I found a major difference between the 3G and 3GS and felt that was a huge upgrade.
The only downside about Windows Phone now is the lack of tethering. I find it a very important feature, so I'm really hoping that gets included in Mango or soon after.