I didn't realize this was news. I did it months ago with Claude. I had Claude build a toy model then train it normally. Then I had Claude manually optimize it's weights to make it maximally efficient at a single task by using as much superposition as was possible. I'm pretty sure we got it to the information theoretical limit, and the resulting model was 90%+ smaller if I recall correctly.

I just assumed that everyone else realized this was a thing.