You end up with city/county hall, local courts, then the lawyers, general contractors, banks etc all clustering around that. There's a natural clustering of resources that happens just from local government. It's not uncommon for the largest hospitals in the region to be near city hall. From there it just snowballs.

That said, I'm not sure why the neighborhood around San Jose's City Hall is so dead, it's very odd experience to go there