When rates fall, prices for assets like homes tend to rise in proportion shortly after, such that the cost to borrowers is approximately constant. The benefit of falling rates goes more to homeowners, even if they don't have mortgages.