Re:Chomsky on What ChatGPT Is Good For
by geysersam on Sunday May 25, 2025 @09:32PM
(#44093062)
How can you make that claim? Have you ever used an LLM that hasn't encountered high school algebra in it's training data? I don't think so.
[ Parent
| on HN ]
I have at least encountered many LLMs with many school's worth of algebra knowledge, but fail miserably at algebra problems.
Similarly, they've ingested human-centuries or more of spelling bee related text, but can't reliably count the number of Rs in strawberry. (yes, I understand tokenization is to blame for a large part of this. perhaps that kind of limitation applies to other things too?)
Re:Chomsky on What ChatGPT Is Good For
by CamperBob2 on Monday May 26, 2025 @01:26AM
(#44094233)
Similarly, they've ingested human-centuries or more of spelling bee related text, but can't reliably count the number of Rs in strawberry
Sigh