I don't know the regulations of California but where I live the city has prohibited the construction of smaller units (1 bedroom, less than 700 square feet) thru zoning regulation and the existing stock of smaller units has been converted to bigger units.

I think if you look for a general reason why we don't have cheaper housing thru smaller units more suitable for people living alone, you will find that it is the explicit policy of the bigger cities.