Wouldn't somebody need to answer the question below? Or do you mean the discussion of its weakness might somehow make it stronger the next time it's trained?

I think it can be both, what happens if discussing weakness provides more relavent links for the question and help the model that is trained scraped web data to learn somehow.

I am not sure if the model will need the exact answer or just the backlinks to site where they can find them is enough. Maybe just documenting how to do it could do the job as well...

Well, to test research capabilities, one could just adopt the year (2024->2025) in the prompt.

I am not sure what happens if some site keeps tracking these metrics and that manages to find its way into the training data.

There are some NBA fan sites that do keep track of some of these tournament level final metrics.

I had o3 "cheat" yesterday. I tried to demo a Deep Research task to a friend, but o3 managed to find the answer immediately in a Reddit comment I'd made after trying out the same problem previously.

I was still impressed though!