I think considering this as a zero sum exchange is pretty unhealthy. Different activities have very different trade offs. Why is lesuire time considered unproductive? Does everything need to obviously contribute to something you feel is productive? Can lesuire activities contribute to productivity?

Personally I think spending time playing games, reading, watching tv and other activities are essential to remaining productive. Not least because they are all interesting input to consider things in different ways. But also because they give me space.