Re:AbsenceBench: Language models can't tell what's missing
by bearseascape on Friday June 20, 2025 @08:18PM
(#44333373)
The madlib like sentences approach is actually how masked token prediction works! It was one of the pretraining tasks for BERT, but nowadays I think all (?) LLMs are trained with next token prediction instead.
[ Parent
| on HN ]
There are no comments on this comment yet.