Re:Gemini 4 Neon
by cavisne on Wednesday November 18, 2026 @11:41PM
(#50556155)
My theory is firstly its focus - they got to skip to GPT 4 (ie clean room implementation by the same people), they never cared about consumer or video gen or image gen.
Secondly, they somehow made all this work on public clouds with really crappy (compared to baremetal nvidia) networking. I think thats probably a lot of post training (which doesn't need such a large/tightly connected cluster), and some architecture that is less reliant on a tightly connected cluster for pretraining. This would also explain why they have been able to use Trainium, and somehow beat Google while using TPU's.
Secondly, they somehow made all this work on public clouds with really crappy (compared to baremetal nvidia) networking. I think thats probably a lot of post training (which doesn't need such a large/tightly connected cluster), and some architecture that is less reliant on a tightly connected cluster for pretraining. This would also explain why they have been able to use Trainium, and somehow beat Google while using TPU's.