Real estate prices are one reason. The other is that your waiting time for a shared self-driving car will be almost nothing (around 5 min?), specially in suburban areas. Keep in mind that is very likely that your kids will go to school on a self driving bus, in any case.
I hear what your saying but can't you use the same logic with bathrooms? Sure, we could all get by with 1 bathroom. Hell, we can get by with just communal bathrooms. But it turns out it's nice to have the luxury of not sharing things, even with your family. It's nice to be able to customize things the way you want. I will buy the argument that people will give up personal car ownership when I start to see people give up having personal bathrooms.
there are lots of places where people don't take public transportation now, why is that going to change? So long as work schedules are similar and eating times are similar it seems like there is a queue theory problem with your community pool.