Yes. People from San Francisco want the 49ers to win, because they're representatives of a kind. But there's nothing particularly manhood-affirming in this experience. People don't want their team to win in order to feel more masculine; as you said, it's a tribalism thing. That's why sports-watching is accompanied by other activities, like exclusion, beer-drinking, steak-grilling, and so on.
The reason you watch sports to affirm your manhood is because you feel you know better. You could, in their shoes, stomp the other team into the ground. You could tell your team what to do and they'd do it and they'd win. This isn't tribalism; such people would happily switch sides in order to prove they could win from there, too.
Listen to the content of the conversation. A bunch of guys, sitting around, agreeing with each other on what they would have done instead. If their team loses, the tribally motivated will say, "Better luck next time." Those who are motivated by masculinity say, "Should have done it better." It's indistinct if their team wins; they have nothing to prove because they backed the right horse.
People usually don't watch sports to affirm their manhood. Activities for doing that tend to be active. But when they do, it's not about tribalism.
A man might enjoy throwing around a football because of the visceral experience of a solid catch, the nostalgic recollection of doing it with his dad, the anticipation of doing it with his son in the future, the vicarious simulation of a quarterback he looks up to, the amorphous pleasure of exercising, and because he can throw it further than his buddy.