News for hackers. Stuff that matters.
Re:TinyStories: How Small Can Language Models Be and Still S... by acchow on Thursday January 02, 2025 @11:33PM (#42582459)
The way we do LLMs now is that the program and the data are one and the same. The program mutates itself as it "executes". This is probably also how the brain works since there is no hard separation between "memory" neurons and "data processing" neurons. (biology has no hard separation in general).

There are no comments on this comment yet.