He's really not. The banks are only involved so that he doesn't have to sell as much of his Tesla shares. And that's to say nothing of his private ownership of SpaceX, probably also worth a decent chunk.