Sounds like you are the breadwinner, have you thought about the financial feasibility of taking an afternoon off, at least until the kids are at school and a lot more independent?

One hobby I picked up when my kid was about three was crochet (men can do it just fine), so we spent afternoons at the playground, she playing with other children while I did crochet e.g. a hobby horse.