News for hackers. Stuff that matters.
Re:Double Descent in Human Learning by topaz0 on Wednesday April 26, 2023 @08:16AM (#35712486)
I would have thought the "few parameter" high-error region corresponds more naturally to the part of language learning where the learner overgeneralizes and thinks everything is regular, and the "many parameter" high-error region corresponds to knowing the irregular forms for each word that you've encountered. But this blog seems to think of it in the other way around. Maybe I'm missing something.
Re:Double Descent in Human Learning by arthur2e5 on Thursday April 27, 2023 @03:42AM (#35724568)
It can be argued that the human case correlates better with the "data double descent" model, assuming the brain network size does not change. The thing is... it does! It goes up and down as connections grow and get pruned. Biology is messy. Biological analogies can never be perfectly clean, especially for a system as giant as a human.