News for hackers. Stuff that matters.

A comment on Pretraining on the Test Set Is All You Need.

Re:Pretraining on the Test Set Is All You Need by RecycledEle on Saturday October 28, 2023 @11:13AM (#38050414)
Is this a joke?

I guess there are cases where training on a tests set is reasonable, but why use a LLM in that case?

[ Parent | on HN ]
Re:Pretraining on the Test Set Is All You Need by SubiculumCode on Saturday October 28, 2023 @11:18AM (#38050448)
The Discussion lets on that it is satire. So does Table 1.
[ Parent | on HN ]
Re:Pretraining on the Test Set Is All You Need by naniwaduni on Saturday October 28, 2023 @03:23PM (#38052626)
So does the title. And the abstract, if you have enough of an understanding of the field to make it fruitful to be reading prepubs in the first place...
[ Parent | on HN ]
Re:Pretraining on the Test Set Is All You Need by YetAnotherNick on Saturday October 28, 2023 @12:18PM (#38050978)
> Disclaimer: if you haven’t figured out by now that this manuscript is satire, this manuscript is satire.
[ Parent | on HN ]