News for hackers. Stuff that matters.

A comment on Show HN: I built a tiny LLM to demystify how language models work.

Re:Show HN: I built a tiny LLM to demystify how language mod... by CaseFlatline on Monday April 06, 2026 @10:49AM (#47661663)
I am trying to find how the synthetic data was created (looking through the repo) and didn't find it. Maybe I am missing it - Would love to see the prompts and process on that aspect of the training data generation!
[ Parent | on HN ]
Re:Show HN: I built a tiny LLM to demystify how language mod... by vunderba on Monday April 06, 2026 @12:09PM (#47662776)
It's here:

https://github.com/arman-bd/guppylm/blob/main/guppylm/genera...

Uses a sort of mad-libs templatized style to generate all the permutations.

[ Parent | on HN ]