(I seem to recall Zuckerberg doing this for his Palo Alto home with a variable interest rate loan that started with 2% or so)
It's a mortgage in layman's terms as there's some principal and interest, but in reality the financial institution won't send an appraiser, there's no mortgage deed issued to the bank, the balance and interest payments are not sliced and diced into securities to be resold.
With that said, mortgages for LLCs are the preferred financing instruments for real estate investors, so they're actually a significant line of business for some banks and yes, they're very doable.
Or is it that the loan is such a low interest rate that it makes more financial sense to keep making money with his cash through investments, say at ~10% return, to offset the loan interest?
On a macro level, the government penalizes selling of assets at 23.8% (current long-term capital gains + ACA surcharge) and on the other hand encourages borrowing by keeping the rates low and allowing the interest portion to be deducted as an investment expense, so what's a rational person to do?
If one does not need a mortgage, this is actually the recommended way to transact on a high-value property. It makes estate planning easier, it somewhat protects privacy, and when it's time to sell, one simply sells the underlying LLC, which ironically is a much simpler business transaction in most states than selling a piece of real estate.