News for hackers. Stuff that matters.
Re:Study reveals how, when a synapse strengthens, its neighb... by alexbeloi on Sunday June 24, 2018 @06:16PM (#17388670)
My naive take on this is that it makes biologically sense to keep net expected electrical impulses approximately the same before and after strengthening. At the end of the day the brain has energy constraints.

This can-be/is done functionally in ANNs but achieves a different end (avoids over-fitting) but doesn't reducing energy(compute) expenditure in dense ANNs since activation and non-activation is computed in expectation and take the same number of cycles in dense networks.

I'd love to see more work on massive sparse networks, where you actually get compute efficiency if you can reduce number of activation without reducing hurting your optimization target.

Re:Study reveals how, when a synapse strengthens, its neighb... by im3w1l on Monday June 25, 2018 @03:18AM (#17390509)
And apart from speeding things up, it could also have a regularizing effect.