News for hackers. Stuff that matters.
Re:John Carmack at Upper Bound 2025 (slides and notes) by timmg on Friday May 23, 2025 @05:16PM (#44076670)
(If you know) how does that work?

Are the audio/video/images tokenized the same way as text and then fed in as a stream? Or is the training objective different than "predict next token"?

If the former, do you think there are limitations to "stream of tokens"? Or is that essentially how humans work? (Like I think of our input as many-dimensional. But maybe it is compressed to a stream of tokens in part of our perception layer.)

Re:John Carmack at Upper Bound 2025 (slides and notes) by johnb231 on Friday May 23, 2025 @05:26PM (#44076774)
Ask Gemini to explain how it was trained

https://g.co/gemini/share/f64c3358d9fa