Largely it's up to building choice. It's a tradeoff of throughput (more people in a single car) and rider privacy. If it frustrates you, grab a UTA key [0] and that will let you put many elevators into independant service mode where the buttons should do exactly what they say.

[0] https://www.ultimatesecuritydevices.com/Original-OTIS-UTA-ke...