Interesting... I mean knockout already does this (sort of), by setting the learning rate of 10% artificially low. I'm not sure if inverting the common thing is useful, but it might be fun to try.