I had an office at my first position that I shared with one other person, and after that a cube, and that was mostly fine as it removed the majority of the noise.

I don't need necessarily a personal office. But I need them to be reasonable.

A closed off space for just the 6 folks in the team would be fine, and a separate small space for someone to go to for a call or a 1:1.