A simpler explanation to your experiences may simply be disappointment from having expectations unmet. If you were looking forward to a quiet date night without kids, only for them to suddenly come back home after being gone for just an hour, wouldn't you similarly feel such negative emotions as you adjusted to the reality of the situation?