Because startups wanted to work in the "cool" places and the primary cheap real estate in those "cool" areas was warehouses. And your startup wasn't going to spend 3/4 of its cash remodeling the warehouse into offices when there was a 90% chance it was going to go bankrupt anyway.
So, you threw down planks for desks, ran ethernet over the beams and got to coding.
Of course, the money people realized it was cheap everywhere, and so were happy to promulgate it as "the way SV does it".
Maybe we had fewer personal items on our screens due to the internet not being used all that much? We argued that it was nice to be able to turn around and ask someone a question. Maybe it's just because we were such a small close knit team?
On the other hand, we also had fairly large desks as well.
I think the half height ones are a decent compromise. You stand up and you can see the people around you. If you sit, you have your privacy. With stand up desks this can be different, but you can orient desks so that people aren't looking at you from behind.
I can see where if a team grew organically that an open office can work --but you never know when that will change (team changes, management changes, etc.)
There is one thing I do not get. Why did and do so many people who had and have to work in such environment so enthusiastically embrace it?
It was so incongruous to see. People I knew and know of all types so eager to get on board with this new movement. Unfortunately I think they got taken in by the fact that it was the so called cool companies that wanted to expand fast and save on space that espoused it. So everyone* became a believer despite the obvious issues. It was fascinating to see this happen (as well as the frowns for not being on-board with this)
I'm happy to see pushback on this miserable layout.