News for hackers. Stuff that matters.
Re:Xkcd 1425 (Tasks) turns ten years old today by sigmoid10 on Thursday September 26, 2024 @01:28PM (#41660980)
You can train the model to do these things in the same way you can train a blind person to describe the colors of objects. But if you put them in an unknown environment or give them a texture they've never encountered before, they will have no idea how to perceive its color. This is a fundamental problem for LLMs and won't change until someone invents a method that gets rid of tokenization for good.

There are no comments on this comment yet.