Re:Micron CEO Says Memory Supply Will Be Much Tighter in 202...
by lnenad on Thursday October 01, 2026 @03:53PM
(#49926299)
> The catchup models are all basically distillations of the sota models
Source/citation?
Re:Micron CEO Says Memory Supply Will Be Much Tighter in 202...
by wood_spirit on Friday October 02, 2026 @02:58AM
(#49930585)
https://www.dwarkesh.com/p/john-beren-charlie Is one of many and it describes how the dynamics well and talks about how proxy logs help.
Re:Micron CEO Says Memory Supply Will Be Much Tighter in 202...
by lnenad on Friday October 02, 2026 @03:09AM
(#49930657)
Thoughts/opinions aren't source.
Re:Micron CEO Says Memory Supply Will Be Much Tighter in 202...
by wood_spirit on Friday October 02, 2026 @12:14PM
(#49935211)
The people in that interview stating this are working at the forefront of open source models and research and includes a cofounder of OpenAI. They don’t say it like it is conjecture.
So on the one hand you have all the sota model makers doing investor expectation management in saying wet need a slowdown for safety (may or may not be true, but also means they don’t spend on the next training cycle before IPO? Could be making their books look better too?) and on the other we have a sense that the models aren’t yet at the stopping place where we can just not train another cycle and use distillations of the current generation?