The implementation details don't matter. LLMs not being able to properly reason though is a fundamental limitation and no amount of re-running will help.
Re:QwQ: Alibaba's O1 Like Reasoning LLM
by fennecfoxy on Thursday December 05, 2024 @07:14AM
(#42327414)
"But that doesn't make sense because Sally can't be her own sister."
Having said this, how many 'lines' of reasoning does the average human need? It's a weird comparison perhaps but the point is does it really matter if it needs 100 or 100k 'lines', if it could hide that (just as we hide our thoughts or even can't really access the - semi-parallel - things our brain does to come to an answer) eventually and summarise it + give the correct answer, that'd be acceptable?