There are detached homes in Singapore - their price and taxes just reflect the fact that about a hundred people would normally be living on the same ground, and those people have to be compensated.

I think a fairer comparison in terms of relationships is like polygamy: forbidding people to live above or below you is a bit like taking away extra potential spouses. I believe polygamy is illegal in most societies due to the inequalities it causes.