It so happened once that iPhone removed an app that I didn't use for some time to save space on the phone, leaving behind just an icon shortcut. When I tried to use it, it tried to download it back, but couldn't, because the app had been removed from the store.

So by default you can't count on your apps staying on the phone.