> I have the rule to not provide my phone number and email address to certain institutions (e.g., banks, the government, insurances).

Where do you live that this is possible? I'm genuinely curious. In most places a phone number is required to open a bank account or use most/any government services.