You are confused. Apple never removes apps from users' devices simply because the new version did not pass review.

Removing an app from the App Store, and removing it from user's devices are two very different things. When any app is removed in this fashion, all users who already have the app still have access to everything they had access to before. The app just isn't listed on the App Store for new downloads.