News for hackers. Stuff that matters.
Re:The "confident idiot" problem: Why AI needs hard rules, n... by jordanb on Monday December 08, 2025 @11:39AM (#46194403)
The servile stuff was trained into them with RLHF with the trainers largely being low-wage workers in the global south. That's also where some of the other stuff like excessive em-dash stuff came from. I think it's a combination of those workers anticipating how they would be expected to respond by a first-world employer, and also explicit instructions given to them about how the robot should be trained.
Re:The "confident idiot" problem: Why AI needs hard rules, n... by OkayPhysicist on Monday December 08, 2025 @12:33PM (#46195129)
I suspect a lot of the em-dash usage also comes from transcriptions of verbal media. In the spoken word, people use the kinds of asides that elicit an em-dash a lot.
Re:The "confident idiot" problem: Why AI needs hard rules, n... by mrguyorama on Monday December 08, 2025 @01:59PM (#46196219)
I would bet like a dollar that the supposed em-dash usage (which I'm not convinced is an accurate take in the first place) would have come from an enterprising dev somewhere being like "Well, we probably don't need multiple tokens for hyphens" and coercing every dash type thing to just one hyphen like token.

But I'm also showing off my ignorance with how these machines turn text into tokens in practice.

Re:The "confident idiot" problem: Why AI needs hard rules, n... by TeMPOraL on Monday December 08, 2025 @03:57PM (#46197572)
I think all the em-dashes came from scraping Wordpress blogs. Wordpress editor does "typography", then thus introduced em-dashes survive HTML to Markdown process used to scrap them, and end up in datasets.

EDIT: Also PDFs authored in MS Word.

Re:The "confident idiot" problem: Why AI needs hard rules, n... by thfuran on Monday December 08, 2025 @02:31PM (#46196558)
If that were true, it would mean that it couldn't output hyphenated words without turning the hyphens into em dashes.
Re:The "confident idiot" problem: Why AI needs hard rules, n... by seanmcdirmid on Monday December 08, 2025 @02:39PM (#46196634)
Two dashes is still a token. You would only be correct if LLMs were still thinking at the level of characters.