Re:Pretraining on the Test Set Is All You Need
by waveBidder on Saturday October 28, 2023 @02:20PM
(#38052142)
If I were you, my take away would be that if you can't evaluate a paper critically enough to immediately tell this is satire, maybe stick to sources that have been vetted by those who can (published papers, books, etc) until you're familiar enough with the field. Arxiv is for researchers communicating with other researchers, and the tendency of AI/crypto groups to use it for marketing has been a disservice to the public.
[ Parent
| on HN ]
Re:Pretraining on the Test Set Is All You Need
by gardnr on Saturday October 28, 2023 @03:11PM
(#38052533)
There aren't any special critical evaluation skills required. The arxiv page says:
> Comments: 3 pages, satire
Tangentially, it's worth pointing out that you are gatekeeping read access to a resource because of a write access problem. If you don't want open access then go back to Elsevier.
Re:Pretraining on the Test Set Is All You Need
by xboxnolifes on Saturday October 28, 2023 @03:31PM
(#38052684)
Technically they're gatekeeping because of a read ability problem.
Re:Pretraining on the Test Set Is All You Need
by gardnr on Saturday October 28, 2023 @04:06PM
(#38052945)
You are correct! I must have had a read ability problem when they conflated the two issues.
Re:Pretraining on the Test Set Is All You Need
by waveBidder on Saturday October 28, 2023 @06:40PM
(#38054072)
I was giving advice for how to learn a subject. The text is obviously satire even without the warnings if you understand the fundamentals of ML. I'm not saying they need a PhD or something.
I have no problem with open access, and would rather journals were required to be open access. But reading brand new results that haven't had any peer review without familiarity with the field is putting the cart before the horse. I certainly don't learn a new subject by reading the hottest papers on arxiv.