News for hackers. Stuff that matters.

A comment on My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air). Parent comment

Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by 0x457 on Tuesday July 29, 2025 @03:26PM (#44727316)
Because internally, there isn't a difference between correctly "recalled" token and incorrectly (hallucinated).
[ Parent | on HN ]
Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by pbhjpbhj on Wednesday July 30, 2025 @10:24AM (#44734656)
Depends on the training? If there was eg RLHF then those connections are stronger and more likely; that's a difference (but not a category difference).
[ Parent | on HN ]
Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by 0x457 on Friday August 01, 2025 @12:53PM (#44759348)
Yes, but I thought we're talking about category difference.

Proper RLHF surely boosts "predicted next token until it couldn't" to feel more like "actually recalled".

[ Parent | on HN ]