My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)

Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by mr_toad on Tuesday July 29, 2025 @02:29PM (#44726775)

> They remix and rewrite what they know. There's no invention, just recall...

If they only recalled they wouldn’t “hallucinate”. What’s a lie if not an invention? So clearly they can come up with data that they weren’t trained on, for better or worse.

[ Parent | on HN ]

Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by 0x457 on Tuesday July 29, 2025 @03:26PM (#44727316)

Because internally, there isn't a difference between correctly "recalled" token and incorrectly (hallucinated).

[ Parent | on HN ]

Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by pbhjpbhj on Wednesday July 30, 2025 @10:24AM (#44734656)

Depends on the training? If there was eg RLHF then those connections are stronger and more likely; that's a difference (but not a category difference).

[ Parent | on HN ]

Re:My 2.5 year old laptop can write Space Invaders in JavaSc... by 0x457 on Friday August 01, 2025 @12:53PM (#44759348)

Yes, but I thought we're talking about category difference.

Proper RLHF surely boosts "predicted next token until it couldn't" to feel more like "actually recalled".

[ Parent | on HN ]