Re:Double Descent in Human Learning
by alphydan on Wednesday April 26, 2023 @05:48AM
(#35711397)
An alternative explanation is that your google-fu is not as good as openai's crawlers or the WebText corpus (which can go a lot deeper than any of your searches).
[ Parent
| on HN ]
Re:Double Descent in Human Learning
by Buttons840 on Wednesday April 26, 2023 @09:40AM
(#35713494)
Makes me wonder how Google would compare if a good portion of the entire world hadn't spent decades trying to game their system. OpenAI created a completely new system and reaps the benefits of training on data that hasn't been twisted-half-way-to-hell to exploit it.