If you're willing to root your phone there's an xposed privacy framework that inserts itself between the OS and snoopy apps to allow finer access control.

http://repo.xposed.info/module/biz.bokhorst.xprivacy

This allows you discretion for apps you still wish to install but demand too many privileges.