I agree with everything you said there

So I think our difference relies in how much our happiness is tied to relating to others

And I'm not sure how we can answer that. But I do feel my happiness rarely relies on relating to others, instead it relies more in socializing (laughing out loud or playing games with friends), and by making progress towards my moralistic goals, mostly with the point of view centered at society, our species, or all life beings