Re:DeepSeek-R1
by naasking on Tuesday January 21, 2025 @10:18AM
(#42781021)
Strawberry is "difficult" not because the reasoning is difficult, but because tokenization doesn't let the model reason at the level of characters. That's why it has to work so hard and doesn't trust its own conclusions.
[ Parent
| on HN ]
Re:DeepSeek-R1
by QuadrupleA on Tuesday January 21, 2025 @12:16PM
(#42782657)
Yeah, but it clearly breaks down the spelling correctly in it's reasoning, e.g. a letter per line. So it gets past the tokenization barrier, but still gets hopelessly confused.