Even in a society of 1 person that person would prefer to live in a mud hut than outside getting rained on. Ignoring imputed rent ignores that value and therefore is objectively wrong.