I think you missed the point: Nobody reads the warnings or notifications. Which is why it's absolutely an issue.

And yes, I routinely revoke permissions for dozens of sites from all sorts of Chrome permissions that the user doesn't even remember visiting, much less authorizing. People just click stuff.