Re:Llama 2 – Meta AI
by gamegoblin on Tuesday July 18, 2023 @03:11PM
(#36777756)
This is due to the tokenization scheme. These LLMs can’t see individual characters, they see chunks of characters that are glued together to form tokens.
It’s impressive that they understand individual-character-level questions as well as they do.
It’s impressive that they understand individual-character-level questions as well as they do.