Normal practice is a prompt-on-first-attempt: when you click on various things, it'll ask; I've never given it access to anything, and so I get a prompt asking for permission to see my contacts about once a week.