However at least on my Cyanogenmod device I've experienced apps breaking 100% if you deny it a permission. Even if that permission should not be vital to the functioning of the app.

It's great that you can filter permissions, but when you suddenly can't use basic functionality because the programmers added obligatory geolocation to a feature, then you don't have much choice. Remove the app, or allow it to track you.