Re:Grok 4.6
by stingraycharles on Thursday August 13, 2026 @02:54AM
(#49282545)
That’s not how training pipelines work, and would be extremely wasteful for the biggest cost center as well.
How about expanding a little instead of just saying "that's not how training pipelines work".
Re:Grok 4.6
by vorticalbox on Thursday August 13, 2026 @07:55AM
(#49284651)
pretty sure at this point no one is retraining from zero they have their big model and they fine tune it.
different training makes a different version (agent, info sec etc).
The GPT-5.5 and 5.6 Spud pretrain is a fresh pretrain run.
OpenAI has the Doug/Astro pretrain coming up next.
I was under the impression labs released post-training checkpoints fairly often?
So Model N/N+1 might literally have had the exact the same pretraining run and only differ on how much/what kind of postraining they got
This explanation does so much without leaning into conspiracy that the labs are already sitting on the secret sauce but diluting it for the public or being left mystified when a lab drops out of the race for SoTA
Re:Grok 4.6
by simplyluke on Friday August 14, 2026 @12:10PM
(#49300716)
I've been hearing this myth since ChatGPT came out - that the labs have superAI that they're just slowly trickling out as competition forces them to.
Everyone in silicon valley has a cousin who's supposedly seen Anthropic's new unreleased model that changes everything forever. I distinctly recall sitting in a work meeting where a coworker was insisting GPT4 was AGI that anthropic was too scared to release. It's amazing to me that this playbook is still working at least somewhat on folks.
So what you experience as a "near simultaneous" release is just their decision of when to peel off a release from their current set of in-training models, likely based on how they perceive market and regulatory conditions. They likely see a competitor release and then baseline what they should release based on that and it takes a month or two for them to package it up and push it out the door.
What I can imagine is that for some of the labs, they are being forced to publish models closer and closer to the frontier of what they have in training. Effectively, "falling behind" is your forward pipeline shrinking. Google ran out of forward pipeline. So far Anthropic and OpenAI didn't - but probably, one is shrinking.