Am I missing something or is this just optimization with lots of trial and error? I mean look at this tool_calls[1] log, it ran ~100 python scripts to get to the solutions. It just seems like it's fitting a function in the only way it was allowed.

I will say that it's pretty wild to see all the different hypotheses tested.

[1] https://github.com/RikiyaT/lm_understand-logs/blob/main/exp8...