Your fear is valid. One way I solved it (partly) is to hire help. Use your financial comfort to buy back your own time by paying someone else to do chores like cleaning, dishes etc. And the 1-2 hours per day that you'll save, now you can spend with your kid and/or on your interests.