Re:R-Zero: Self-Evolving Reasoning LLM from Zero Data
by yunohn on Wednesday September 10, 2025 @12:37PM
(#45200218)
My observation of AI progress over the past 2yrs has shown that LLM companies are focusing purely on raw model knowledge instead of optimised usable tooling. Unsure when this will ever change, but that’s why your example is not the industry’s standard yet.
Re:R-Zero: Self-Evolving Reasoning LLM from Zero Data
by mvdwoord on Wednesday September 10, 2025 @12:54PM
(#45200494)
My intuition, which is of course woefully inadequate in this area, says there is a ton of accuracy to be gained, and I feel also a lot of offloading and therefore pruning or better use for the rest of the parameters...
Anyway,. let me refresh my page, as I am sure while typing this some new model architecture is dropping. ;)
Or is there a more subtle issue which prevents or makes this hard?
Is there something fundamentally impossible about having a model detecting the amount of Rs in 'strawberry' to be a string search operation and in some sandbox execute something like:
% echo "strawberry" | tr -dc "r" | wc -c
It seems agents do this already, but regular GPT style environments seem to lack it?