Re:Gemini 4 Neon
by iamdelirium on Wednesday November 18, 2026 @05:19PM
(#50553070)
Looped transformers have been known for years now. I don't think it's something new.
Re:Gemini 4 Neon
by onlyrealcuzzo on Wednesday November 18, 2026 @05:21PM
(#50553107)
They are JUST arriving to frontier models.
Even in the open weight Chinese models as small as DeepSeek V4.1 Flash - nothing is looped.
Re:Gemini 4 Neon
by refulgentis on Wednesday November 18, 2026 @05:28PM
(#50553207)
I think they're responding to the claim Astra can't be looped, there's clear and convincing research, as well as public comms, that it is. It's unclear why Astra can't be looped because looping is new, but, 6.1 Sol released a week later can be.
Re:Gemini 4 Neon
by refulgentis on Wednesday November 18, 2026 @05:26PM
(#50553194)
Astra was the first shipping looper. Unconvincing evidence would be reporting x OpenAI's quick reaction to it via a blog post from their chief research (it broke what's considered a safety taboo). Convincing evidence would be research from ex. Neel Nanda on serial reasoning, recent update at https://x.com/EpochAIResearch/status/2122762411287748696?a=J...
This doesn't really make sense given how the models released.
OpenAI released Astra long before latent-space looping was a thing at the frontier space.
Then they released Sol 6, which was fast, clearly not looped. Then they release Sol 6.1 which was nearly as good as Astra, but way cheaper, and WAY slower -> this would follow it just being a looped version of Sol 6.
It doesn't seem likely that Astra 6.2 is just a looped Astra 6... It's too fast, and they'd go bankrupt if they're charging the same price... It may be a further looped version of Sol than Sol 6.2 - which would explain why it's not as much better as we would've hoped.
It may also explain why their release is not going as well as they hoped. It's hard to predict how your first looped models are going to fare.