I disagree about the reason to be miserable since no one wants to be miserable. But otherwise I agree and am practially doing the same thing as you are at the moment. :)
If we agree that being happy is better than being miserable, and time is limited resource, then yeah, it is logical to favor and seek happiness over misery.
See... I think that thought and I continue with "what does it matter if I'm only with one person? My contribution to the world is not going to be based on how sexually satisfied I am."
I have whatever sex I need to get it off my mind so that I can work on my hobbies and interests without distraction. "I'm going to be dead" is just as much a reason to be miserable as it is a reason to be happy. (That is, they have nothing to do with each other whatsoever.)