Yes, and for others' reference, Astra is the one SOTA model known to be looped.
Looping is controversial among the alignment/safey crowd, because the more models can think without printing a trace, the less understandable they might be to us.
Looping is controversial among the alignment/safey crowd, because the more models can think without printing a trace, the less understandable they might be to us.
- It lets the model do more of its reasoning without emitting tokens. This is helpful both because a) insanely long token streams are annoying, but more importantly b) long reasoning streams eat context. It's not a direct performance enhancement, since each token is more expensive to generate (you need to loop!), but it reduces spam in the context window which likely translates into some degree of intelligence win for multi-turn since the model won't have to sift through as much noise, and it'll need to compact less frequently per task which is also likely an indirect intelligence win and an indirect cost/perf win per task: post-compaction re-reads of files are basically useless spam to an inference engine, so if you could do the entire task within one context window, you'd hit the engine less per task.
- It lets potentially every token use more computation, instead of keeping the test-time-compute scaling purely in the upfront CoT domain. While it's helpful to think upfront, it can be useful to think mid-stream too.
Overall it's potentially much better.