I have two kids and a mortgage--I think I understand where you're coming from. If toughing it out or raising your issue up the chain are not options, it's best to start looking for a new gig in the evenings after the kids go down.