AI would be deployed to behave like the median doctor (at best - or maybe the lowest-common-denominator) to avoid blowing up costs with 99%-likely-to-turn-up-nothing hunts for super-rare conditions.

Today you can try to cajole your human doctor into listening more, or ordering more tests, or considering things you heard online or from acquaintances. AI will be guided to take that into account less because a doctor being more sympathetic and bypassing "standard practice" is an expense caused by humanity that the machine can be trained to avoid.

Today you can go across town and try your luck with another doctor. If it's all AI, you'll just repeat your story to the same basic model and get the same basic dismissal.

The problem arose from trying to make people behave like machines in order to save money. Making a machine behave like a machine ain't gonna help.

You need to shift the goal from "saving money" to "helping people." AI doesn't do that.