News for hackers. Stuff that matters.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by danielmarkbruce on Wednesday June 05, 2024 @08:01PM (#40592004)
Beam search.

Sophisticated folks aren't doing the worlds most simplistic/stupid decoding.

Gotta go beyond LLMs 101 to see what's actually happening. Even in training folks are predicting several tokens ahead.

There are no comments on this comment yet.