You can actually do all of that meta analysis if you have the conversation that led to the solution. This is as easy as just having people release logs of their conversations, and then you can load it into another LLM as context to ask a bunch of questions about it.

I hope this will be normal practice eventually. “Show your work” is trivial if you use AI to solve a problem.