News for hackers. Stuff that matters.
Re:Double Descent in Human Learning by alphydan on Wednesday April 26, 2023 @05:48AM (#35711397)
An alternative explanation is that your google-fu is not as good as openai's crawlers or the WebText corpus (which can go a lot deeper than any of your searches).
Re:Double Descent in Human Learning by Buttons840 on Wednesday April 26, 2023 @09:40AM (#35713494)
Makes me wonder how Google would compare if a good portion of the entire world hadn't spent decades trying to game their system. OpenAI created a completely new system and reaps the benefits of training on data that hasn't been twisted-half-way-to-hell to exploit it.