It will be faster but still annoyingly slow even if you kept all the cars off the bus lanes where they don't belong, or even removed them from the streets altogether. Can't really go fast with a bus without running over pedestrians at every intersection. Good public transit has dedicated rights of way.

I'm also curious how you think people from Manteca should be commuting to the city.