You don't need that many crazy people on SF Muni/buses for it to cause a problem for everyone else who might want to take a bus.

But yeah the fact that it's often faster to walk (and definitely faster to take a bike/scooter) is also an issue.