> So if you wished to include such images in training, you would also need an explainable AI that could tell you exactly what training inputs are influencing its output.

That would be like requiring human artists to enumerate exactly every single influence on each piece of art they make. Did they see a painting by so and so at six years old that had a 0.1% influence on them? Better include it too.