But surely you notice that when interest rates go up and down, that movement is tied to changes in expectations of inflation?

The '80s homebuyer did great on their purchase, but not because borrowing at 20% was such a steal. They profited because their home subsequently went up in price faster than inflation did.