News for hackers. Stuff that matters.

A comment on Show HN: How LLMs Work – Interactive visual guide based on Karpathy's lecture. Parent comment

Re:Show HN: How LLMs Work – Interactive visual guide based o... by thesz on Saturday April 25, 2026 @06:06AM (#47900177)
BPE that is used in tokenization is very simple: https://en.wikipedia.org/wiki/Byte-pair_encoding
[ Parent | on HN ]

There are no comments on this comment yet.