This, like reproducibility in machine learning workflows, is one of those things that needs to be baked in at the start or will become a complete nightmare.