Do Machine Learning Models Memorize or Generalize?

Re:Do Machine Learning Models Memorize or Generalize? by firecall on Thursday August 10, 2023 @08:33PM (#37083597)

Does the brain require more energy to store more information?

Or is it always running at the same pace regardless of if it’s empty or not?

I guess the Brian doesn’t really work like that…. But I’m curious :-)

[ Parent | on HN ]

Re:Do Machine Learning Models Memorize or Generalize? by ReactiveJelly on Thursday August 10, 2023 @10:02PM (#37084232)

The brain doesn't seem to ever "clock down" when it's idle, which is interesting to me

https://en.wikipedia.org/wiki/Human_brain#Metabolism

> The energy consumption of the brain does not vary greatly over time

[ Parent | on HN ]

Re:Do Machine Learning Models Memorize or Generalize? by gmadsen on Thursday August 10, 2023 @10:59PM (#37084632)

maybe between sleep and normal waking idle because there is actually quite a bit going on during sleep. There has been quite a bit of research though regarding higher "clock up" states consuming far more energy, such as grandmasters playing a chess tournament

[ Parent | on HN ]

Re:Do Machine Learning Models Memorize or Generalize? by lobocinza on Saturday August 12, 2023 @11:16AM (#37101034)

My lazy research pointed to 6K calories which is a lot more than a typical person can burn by physical exercise.

[ Parent | on HN ]