The reality is it only takes 2-3 seconds to allow it, it’s a direct link to the relevant setting. Once you allow it for that app (say, Chrome or Google Drive) you don’t have to do it again unless, of course, you disable it.