Hop in a car or on BART on the weekend, go 15-20min east and you can hike in the sun or wander around Berkeley/Oakland in warm weather. That said, March to April/early May and Sept-Nov are generally quite glorious.

Fog is a nice to have, you can always travel a short bit to avoid it.