I don't have friends for the sake of "having friends". I choose the people I want to hang out with because I enjoy their company and like/respect them. Being around them makes me happy.

Similarly, people I dislike (rude or mean people, for example) make me unhappy when I'm around them. Cutting them out of my life is a net benefit there too, because I'm happier without them.