You don't have to spend the "free to spend" money, and you shouldn't feel bad for not spending it.

Maybe collect the unspent amounts into an "Emergency Fun" fund, so you can dip into it if you have a crisis related to fun (gaming device breaks, see something really cool that you want to have or do, etc)