It doesn't infringe on anything unless you believe everyone must make the same choices you've made. If your employer is making you work long hours because someone else is, that's on your employer, not the employee who is voluntarily working long hours. Nothing is stopping you as an employee from putting in more time if you want to or leaving if you don't, but depriving others of an opportunity to choose their own priorities is not a right anyone has.