Muse Glimmer and Qwen still finish that particular task in their highest reasoning levels without blowing through such a limit.
I will redo my testing at some point at lower effort.
But I would note again that even in extra high thinking mode, it went down a significant rabbit hole to try to make some code work off the basis of a “core” wordpress hook it had actually invented, and nothing I could do would get it to use the correct hook. When I told it about the correct hook what it actually did was engage in a series of tool calls to verify its original understanding, which of course failed to come up with results because the hook it was verifying did not exist. But it continued stubbornly, until it reached a point where it would blankly fail to call tools it said it would call.
I might retest with the Q8 version since it is not that much larger.
FWIW I run Muse Glimmer on “Reasoning strength: low”. It’s perfectly fine; I am not convinced xhigh makes that much difference.
I ultimately simply prefer the way Muse Glimmer works for the turn-by-turn assistant type usage I want; it thinks concisely, writes fairly well too. Struggling a little with tools for it in Pi, though.
> my test prompts in "extra high"
> The model burned through 19200 thinking tokens on this task (which was the hard limit I had set) and didn't finish
I still haven’t caught on to why people keep doing this. Benchmarks too. It feels like a masochistic exercise entirely removed from reality.