This is what it looks like looking towards Chicago's Loop from Ogilvie: http://maps.google.com/maps?q=Ogilvie+Transportation+Center,...
This is what it looks like looking towards Midtown from Grand Central: http://maps.google.com/maps?q=grand+central+station,+new+yor...
The same is true for the residential areas. There's almost no high-density development around the Cal Train stations in the Valley. Even in Arlington Heights, IL (a suburb about 25 miles from Chicago) you see substantial high-density development right around the Metra station.
Then if only Caltrain could adopt a not-insane schedule and reasonable frequency, and zoning roadblocks were removed (it looks like most of SV is zoned "parking lots only"), it might actually prove to be a catalyst for development!
Haha... :(
In New York City and its suburbs, nobody needs private shuttles because public transportation actually runs where people live and work. California made the decision many years ago to build roads instead of transit. The current system exists the way it does because of that.