Hopefully somebody else will reply to you because it's been a while for me and I forget the details. There are settings in the Google App itself, settings in your Google Account in general and also I denied the relevant recording permissions for various google apps.

I'm using Lineage at the moment. I'd like to ditch Android entirely but I'm not sure ubports is where it needs to be yet. Unfortunately the open non-Android mobile OS's seem to die before they reach maturity. Obviously it's tough on them if they're competing with an existing app ecosystem, as they are.