You're making the classic mistake of assuming a common thread connects the people who've annoyed you in various unrelated contexts.