I agree. That's why the original statement "Housing was never an investment before recent decades" doesn't make a lot of sense and the justification "Housing tracked inflation for 400 years" doesn't support it even it's correct.

(Btw, not sure if it was implied but the "you" in "you buy some other property and let it out to tenants or businesses" is often a pension fund or mutual fund.)