News for hackers. Stuff that matters.

A comment on Show HN: I built a tiny LLM to demystify how language models work.

Re:Show HN: I built a tiny LLM to demystify how language mod... by drincanngao on Monday April 06, 2026 @07:27AM (#47659509)
I was going to suggest implementing RoPE to fix the context limit, but realized that would make it anatomically incorrect.
[ Parent | on HN ]
Re:Show HN: I built a tiny LLM to demystify how language mod... by armanified on Monday April 06, 2026 @07:36AM (#47659593)
I intentionally removed all optimizations to keep it vanilla.
[ Parent | on HN ]