The main issue is that the GPL stipulates that the licensor cannot restrict distribution above and beyond the GPL's terms. Because apps must also be distributed under Apple's ToS, the app author would violate the GPL (e.g. due to DRM and regional restrictions).
Basically, this is Apple protecting their asses as well as the developer. Any downstream dev could sue you for using their GPL library (or at least force you off the app store). This is why build of VLC was yanked.
The FSF has a good article on it: http://www.fsf.org/blogs/licensing/more-about-the-app-store-...
I'm curious if a developer can incorporate GPL code in their app and make it available only on Google Play or the Amazon App Store while supplying the relevant source code (or object files) — but not making the unsigned/unprotected APK available to the public.