If you want to leave SF/Oakland later than 9 am or LA later than 10 am, you have to take some long bus connections (which aren't very fun) and the San Joaquin or Pacific Surfliner.
So, the state needs to build new trackage through a 3000 ft (~1km) pass getting out of LA, and more trackage through a 1500 ft pass getting out of the SF area in order to use the much more straight and speedy right-of-way going through the middle of the state. Once that's done, and the rights of way along the corridor are upgraded, high speed rail will run between the points. Just gonna take another 15-20 years to do so.
Imagine getting on the train at 7 in the evening, lying on your own bed reading books and drinking tea, sleeping actually then getting off the train at 9 in the morning at the railway terminal in another city.
The other striking thing was train travel in the South being heavily subsidised - huge distances travelled for not much money, with power for your laptop and lots of space to move around. If the train schedule was appropriate for you, you'd be crazy to fly instead.