I think there is hope, there is a very nice paper where they automaticaly produce both heatmaps and textual explanations of the label given by the neural network (used to detect and classify fractures). It is detailled here : https://lukeoakdenrayner.wordpress.com/2018/06/05/explain-yo...