Fair enough but it's not as uncommon as you might think and a lot of people are fine with it as long as consent is required, a bit like open banking. There are quite a few apps in the UK that leverage exactly that, here's one example: https://www.patientaccess.com/