News for hackers. Stuff that matters.

A comment on Pretraining on the Test Set Is All You Need.

Re:Pretraining on the Test Set Is All You Need by asah on Saturday October 28, 2023 @11:19AM (#38050463)
LOL: https://www.google.com/search?q=site%3Aarxiv.org+%22is+all+y...

(apparently, a lot of things are "all you need" !)

[ Parent | on HN ]
Re:Pretraining on the Test Set Is All You Need by unflxw on Saturday October 28, 2023 @12:11PM (#38050921)
Perhaps it's not great to set the expectation that any specific approach to AI "is all you need"?

(or, in other words, "Is All You Need" Considered Harmful)

[ Parent | on HN ]
Re:Pretraining on the Test Set Is All You Need by cmeacham98 on Saturday October 28, 2023 @12:13PM (#38050944)
My understanding is that it's an in-joke in the AI/ML/LLM community, I believe started by the paper 'Attention Is All You Need'.
[ Parent | on HN ]
Re:Pretraining on the Test Set Is All You Need by sva_ on Saturday October 28, 2023 @02:44PM (#38052321)
A significant part of the work in writing an ml paper seems to go into coming up with a catchy title.
[ Parent | on HN ]