Out of experience, once you reached "enough" income to not worry about money constantly, obviously a conservative lifestyle helps, there is no time like today for spending time with family and friends. Spending this precious time to get, maybe, some more in future is a very risky gamble. The only thing I regret so far in my life, lucky it didn't last too long.
When making that calculus, assuming you are talking about a situation where you already have "enough" money or salary, you have to consider the fact that it's possible you will never make it to that big payday you are looking for.
But one thing is certain. Your children will grow old and move out, you parents and grandparents will pass on. Life is short and death and taxes are your only guarantees.
I mean, that can be debatable imo. It's an oversimplification.
To think of it simply; Does spending less time with your family now, mean more time in 2 years? Are the now years more valuable than the 2+ years? Is there a risk of 2 years becoming 10? More time now is great, but what if you're worrying about money constantly? etc
There's a ton of decisions that go into big life decisions. Time with family, even if family is everything in your view, is not the only input. Time is meaningless without context.