This can be fixed - dedicated bus lanes mitigate this nicely - but doing so is politically unpopular. And frankly, if you have the political will then you should just build trains. They're more reliable, cheaper in the long run, and have higher capacity.
The main advantage of buses is that they're a great stopgap, and are good for niche/dynamic routes.
One game-changing technology is the way cameras are cheap now. You can put them on every bus and change drivers’ calculation of the risks of suffering consequences from blocking bus lanes or stops from “less likely than being struck by lightning” to “every time”. That requires political will but the technology makes the cost not only low but self-funding.
* Lack of political will to create separate lanes. City council members are drivers and empathize with their auto driving constituents and would rather have driving lanes available to auto drivers than exclusive to buses
* Better bus stops require better funding which requires raising taxes. Nicer bus stops also tend to attract the homeless. The US has been funding auto driver amenities for almost a century via taxes but only started funding transit in a consistent way federally from the BBB act, and even then only at a fraction of auto improvements.
* A bus route that serves many stops is slow. A bus route that serves few stops is inconvenient for anyone not near those stops. You can run multiple buses along a route with differing levels of service to service both modes, but that requires running more buses, which requires purchasing more buses and hiring more drivers which costs more money.
Most of this comes down to a lack of political will and funding. Most politicians still see driving as the main way to move around and are loathe to fund transit as anything more than an equity initiative to help with the sad folks who cannot drive a car. Until this changes, progress is going to be slow. Likewise most politicians benefit from high housing costs because they themselves live in more expensive, exclusive areas with exclusionary zoning and are more sympathetic to that viewpoint and view housing accessibility as largely an equity initiative.
Send surveys to all the biggest companies in the city to figure out specifically the routes that need to be created.