No need to drive even an hour. Downtown San Jose is certainly a hellhole (I worked downtown on Santa Clara St. for a while) but just a few minutes away there are very nice suburbs like Campbell, Willow Glen etc.