Re:OpenAI cofounder Ilya Sutskever says the way AI is built ...
by numpad0 on Saturday December 14, 2024 @12:23PM
(#42418275)
> What will replace Internet data for training?
It means unlimited scaling with Transformer LLM is over. They need a new architecture that scales better. Internet data respawns when they click [New Game...], oil analogy is an analogy and not a fact, but anyways total amount available in a single game is finite so combustion efficiency matters.
It means unlimited scaling with Transformer LLM is over. They need a new architecture that scales better. Internet data respawns when they click [New Game...], oil analogy is an analogy and not a fact, but anyways total amount available in a single game is finite so combustion efficiency matters.