Yes! This exactly! You can have at most a dozen people round a kitchen table. You can't put the whole company around the same table. The social dynamics simply don't scale that way.

I too have had great experiences doing productive new work in small open offices up to 6 people. I'm currently not enjoying my open office of >100 people. I'd be quite happy with a team-sized office with a door and decent internal sound damping.