Yep, as a medical student, I strongly believe we need explainable AI for healthcare, and that AI only empowers clinicians to make the final call, and does not do any medical decision making autonomously. I really hope other players in the space like Hippocratic AI [1] and Google Med-PaLM2 [2] understand this as well.

[1]: https://www.reuters.com/business/healthcare-pharmaceuticals/...

[2]: https://cloud.google.com/blog/topics/healthcare-life-science...

Do you even need ai? What about just a basic system where you type in some keywords like the symptom presented, it queries a known good source like the physicians desk reference or something, and returns results with a likelihood score to match your keywords? Such a systems seems like it would be useful and also would not need an ai model or expensive training to create.

> Do you even need ai?

Doesn't matter if you need it, AI is used here as a magnet for VC money.