While I agree that there are many confusing jurisdictional pitfalls in incorporation and banking, this isn't one of them. SVB in particular has customers all over the nation and it is ludicrous to suggest that a state's tax authorities would go after customers of banks based in their state as if they had jurisdiction over those customers' business conducted outside the state.
Law is a messy business, but they have literally taken the most typical arrangement for startups in US accelerator programs as the first template for Stripe Atlas. I can't imagine a safer set of choices.
I think the Delaware corp is a fine idea and a good choice here, but combining that with a Silicon Valley Bank bank account gives me pause ...
California really goes after state tax revenue, and I worry that a corporate entity that has no presence in California, and is not a CA corp has created an opening with a SVB bank account to allow CA FTB right in ... and they are aggressive.
I would feel more comfortable if the bank account was also in Delaware...