Tesla is unlikely to take that margin or share of profit from the market.
I feel the bet on Tesla is Elon Musk. And I recognise there is a cult following but consider, how many people in the world have a better chance of opening a new multi-billion dollar category within their company from scratch? If you are going to be on someone, he's not a bad choice.
Now suppose that every hour of the rest of the day, there's only 10 people making a trip of 30 minutes. That means there's only 10% of the traffic volume compared to rushhour on the road. But you're seeing 22 hours of two groups of 10 people making a trip every hour. That's 440 trips.
Now suppose that the two groups of people, rush and non-rush, all used their own cars. You'd have 100 cars for the rushhour group and 440 cars in the non-rushhour group. You get to 540 cars needed.
Now suppose the two groups shared vehicles. You just need 100 cars still to make the same amount of trips.
Under these (made up) assumptions, you can reduce the amount of cars needed by 5x.
Then there's the notion that you can get dynamic pricing, e.g. look at Uber, but for semi-public transport. This incentivises people and companies to distribute their travel in a better manner, which also allows a system where producers of congestion pay for it. Thereby you can distribute load better, increase utilization, decrease the number of vehicles needed even further.
But indeed, you're unable to get to 100% utilization because demand fluctuates during the day. But even increasing it from 10% to 20%, or 30%, would introduce massive changes to the market size.
Nokia was a $90b phone company in 2007. The best-case scenario for a new phone company could in 2007 be expressed as a topping out at Nokia's size (Toyota in your example), but it'd be a moonshot. It'd more likely be an Ericson or Motorola, whose phone divisions weren't half as big as Nokia's. So the best case scenario is $90b, and more likely to be around $30b. And that would've made sense, until you figure Apple drove a market cap approaching $900b, mostly on the basis of its phones, all within 10 years of 2007.
So there's something to be said about the possibility that Tesla doesn't just supplant Toyota to become the car company, but also redefining cars and the size of its market, just like with smartphones. I see some people making that bet. That having been said, I personally think the chance of that happening approaches zero. The points you make are very apt. Self-driving cars means we can increase utility rates of cars (which sit still for 90% of the day) from 10% to say 90%, and that will completely destroy sales volume.