News for hackers. Stuff that matters.
Re:Why neural networks struggle with the Game of Life (2020) by rcxdude on Saturday May 18, 2024 @04:41AM (#40397409)
it's possible, but unlikely. The issue is your training examples are essentially a noisy representation of the general function you are trying to get it to learn. Generally any representation that fits too well will be incorporating the noise and that will distort the general function (in the case of NN it'll generally mean memorising the input data). Most function-fitting approaches are vulnerable to this.
Re:Why neural networks struggle with the Game of Life (2020) by G3rn0ti on Thursday May 23, 2024 @10:28AM (#40455172)
Hm. I see. But, ultimately, overfitting is a consequence of too many parameters absorbing the noise. Perhaps one could fit smaller models and add artificial noise.