>I have a quote I like in this context, “Could you learn gymnastics just from watching videos?”
People seem to have this weird idea that language models learn by some sort of magic osmosis. They're not just "reading" text or "watching" images. They learn by predicting, failing and adjusting neurons based on the data. Text is their world and they are interacting with it.
https://general-pattern-machines.github.io/
https://wayve.ai/thinking/lingo-natural-language-autonomous-...
It's just the straightforward application.
>I have a quote I like in this context, “Could you learn gymnastics just from watching videos?”
People seem to have this weird idea that language models learn by some sort of magic osmosis. They're not just "reading" text or "watching" images. They learn by predicting, failing and adjusting neurons based on the data. Text is their world and they are interacting with it.