Pretraining on the Test Set Is All You Need

Re:Pretraining on the Test Set Is All You Need by gardnr on Saturday October 28, 2023 @03:11PM (#38052533)

There aren't any special critical evaluation skills required. The arxiv page says:

> Comments: 3 pages, satire

Tangentially, it's worth pointing out that you are gatekeeping read access to a resource because of a write access problem. If you don't want open access then go back to Elsevier.

[ Parent | on HN ]

Re:Pretraining on the Test Set Is All You Need by xboxnolifes on Saturday October 28, 2023 @03:31PM (#38052684)

Technically they're gatekeeping because of a read ability problem.

[ Parent | on HN ]

Re:Pretraining on the Test Set Is All You Need by gardnr on Saturday October 28, 2023 @04:06PM (#38052945)

You are correct! I must have had a read ability problem when they conflated the two issues.

[ Parent | on HN ]

Re:Pretraining on the Test Set Is All You Need by waveBidder on Saturday October 28, 2023 @06:40PM (#38054072)

I was giving advice for how to learn a subject. The text is obviously satire even without the warnings if you understand the fundamentals of ML. I'm not saying they need a PhD or something.

I have no problem with open access, and would rather journals were required to be open access. But reading brand new results that haven't had any peer review without familiarity with the field is putting the cart before the horse. I certainly don't learn a new subject by reading the hottest papers on arxiv.

[ Parent | on HN ]