Re:New theory proposes ‘forgetting’ is a form of learning
by karmakaze on Friday January 14, 2022 @10:51PM
(#29943370)
I was thinking something along those lines too. As if a baby starts with a fully connected network of many nodes, then over time experience strengthens some connections as others drop out. If the connections were to return to an evenly connected state everything would have been forgotten, but anything could then be learned as all capacity to learn has returned.
Re:New theory proposes ‘forgetting’ is a form of learning
by renjimen on Friday January 14, 2022 @09:03PM
(#29942890)
Dropout is random, rather than learned. But I can see how it could have a similar effect to forgetting.
Re:New theory proposes ‘forgetting’ is a form of learning
by BearsEatBeats on Saturday January 15, 2022 @02:01AM
(#29944321)
would dropout be considered forgetting or learning to use as little information needed to get the right answer?
https://en.wikipedia.org/wiki/Dilution_(neural_networks)