These ultra high net worth people are getting loans at such low interest rates because the collateral is so much larger than the loan.

If you have $10B in stock, you probably aren't going to borrow so much as to even get close to a margin call in a market downturn.