News for hackers. Stuff that matters.
Re:Ask HN: What are some "toy" projects you used to learn ne... by antoineMoPa on Monday August 12, 2024 @03:41PM (#41228448)
A tiny tiny LLM (essentially removing the "Large" part of "Large Language Model"). I taught neural networks to remember wikipedia articles (Actually, just one wikipedia article about horses.) and throw it back as-is by predicting the next token (when given the first token).

https://github.com/antoineMoPa/tfjs-text-experiment/blob/mai...

There are no comments on this comment yet.