In some cases they also spend a lot of time annotating and measuring small areas of the images and having a model generate suggestions for them would save a ton of time.
I don't think taking the human all the way out of the loop is a great idea given the state of models we've seen to date (in medicine, anyway).
I think a better direction would be looking at how to make these systems more complementary with human operators, surfacing interesting features or distant connections humans tend to miss and guarding against the big errors anyone might make staring at grayscale images on the night shift.
Yes, I agree it should be another, yet increasingly important tool for a while. Perhaps not until a near-AGI is invented that machines can completely automate away doctor jobs.