Thats a lot less cheaty, biologically speaking, than full backprop. This Hinton guy sounds like he knows what he's talking about.

"Context drift as data distribution changes" sounds a hell of a lot like real life to me.

Normalized = hedonic treadmill on long view

At the micro scale, data that overflows the normalization is stored in emotional state, creating an orthogonal source of truth that makes up for the lack of full connected learning.