A lot of people have no interest in having their politicians work them into an outraged frenzy.They just want their officials to do a good job and don't care about speeches and such.

A politician who attracts a more visceral audience is going to superficially look more popular than they actually are.

So going by crowd size can be deceptive.