There's risk being a landlord as well. When a bad tenant trashes your rental, you can be out tens of thousands of dollars in addition to the costs to file and process an unlawful detainer.

If anything landlording is riskier than investing in an index fund.

This is not to say that you should not own rental property. Rental property should be owned in addition to stocks and bonds.