My parents lived in the front half of a duplex house and rented out the back half for years. One night, the tenant fell asleep with a cigarette in his mouth and burned our house down.

The downsides are real.