Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style...
by gamegoblin on Friday March 17, 2023 @12:47AM
(#35193259)
Tokenization is purely an implementation detail. If OpenAI had cared, they could have deleted those obviously glitched tokens from their tokenizer. They just didn't inspect it carefully and/or care.
GPT4 does not suffer from the same glitched tokens as GPT3, presumably because it uses a different tokenizer.
Furthermore, there are LLMs that operate on single bytes instead of multi-character tokens, totally obviating that problem.
The evidence is that there are these "glitched" tokens : https://www.youtube.com/watch?v=WO2X3oZEJOA
if you watched to the end of that video, it explores a very plausible reason why such glitched tokens exist - it is because the training dataset has a bunch of "nonsense" (a large dump of the subreddit that just counts a number, as well as various other "data").
So my hypothesis is that if you attempted the in-context logic training dataset, it would produce large number of glitched tokens (different ones, but equally as "illogical" to the user).