News for hackers. Stuff that matters.

A comment on What Are Transformer Models and How Do They Work?. Parent comment

Re:What Are Transformer Models and How Do They Work? by Hendrikto on Saturday April 15, 2023 @06:56AM (#35579432)
> Skipping over BPE as part of tokenization

Well, there are other methods in use. See ByT5, for example.

[ Parent | on HN ]

There are no comments on this comment yet.