Right, but while medical offices are third parties, they are also something you cannot (literally) live life without. I would argue that makes them extensions of yourself in the sense that they are acting purely on your behalf in an essential capacity. In this way they are like lawyers, who you need to interact effectively like the court system. In that vain, communications with your medical professionals in their capacity as your caretaker should be strongly protected.

That logic applies similarly with your computing devices.