There's a whole field of work around AI Observability - tracing how data moves through a model. It's intended to help identify biases in the input data, and to help answer the question of "why did it make this decision".

And if you can trace how data moves through the model, you can identify "that output came from these inputs" and add the associated metadata.