"Suck" is maybe too strong a term--though it can be the case if most of the team is co-located and there's one person who always has to dial in. A number of teams I work with also have an "everyone dials in" rule even though they're pretty distributed anyway.

As someone who is mostly remote, I never had too much of a problem with hybrid meetings. People in a conference room are pretty respectful that there are people on the phone in my experience. That said, the current situation where everyone is dialing in individually is something of a meeting upgrade overall. People have also gotten better at collaboratively edited agendas etc. not that they were bad to start with.