The opportunity cost of the downpayment (and also the fact that lots of people wouldn't have the money for a down payment anyway). Generally the returns from property investing are relatively low compared to other investments.