News for hackers. Stuff that matters.
Re:LLMs are mortally terrified of exceptions by jcelerier on Thursday October 09, 2025 @08:52PM (#45534512)
LLMs operate at token level, not word. it doesn't operate in terms of "traumatic", "over-training", "over" or "training", but rather "tr" "aum" "at" "ic, ", etc.
Re:LLMs are mortally terrified of exceptions by magicalhippo on Thursday October 09, 2025 @09:14PM (#45534613)
> it doesn't operate in terms of "traumatic", "over-training", "over" or "training", but rather "tr" "aum" "at" "ic, ", etc.

And "毛片免费观看" (Free porn movies), "天天中彩票能" (Win the lottery every day), "热这里只有精品" (Hot, only fine products here) etc[1].

[1]: https://news.ycombinator.com/item?id=45483924

Re:LLMs are mortally terrified of exceptions by TZubiri on Thursday October 09, 2025 @10:31PM (#45534925)
I think you are confusing tokens with vectors/embedding/parameters.

king and rex (king in latin) map to different tokens but will map to very similar vectors.

Re:LLMs are mortally terrified of exceptions by typpilol on Thursday October 09, 2025 @11:19PM (#45535103)
Weird thing I've noticed.

Some LLMs can output nerd font glyphs and others can't.

If I recall grok code fast can but codex and sonnet can't