The key is to talk with you SO and understand their point of view. Odds are they already feel that they've lost you to work for a significant portion of the week... so to then say that you need another night or weekend day can be a lot. It's all about communication and balance and no one answer is right for every couple.

My best advice: Talk to your SO and reevaluate your priorities. You might end up with the same priority list after you do so (which is fine) - but give it a hard look for yourself and your SO.