Sound decays exponentially as a function of distance, so speakers close to you don't need to be loud. Also most speakers are also fairly directional, so i'd expect any extra energy to be absorbed by the room (as heat).

Edit: more importantly these are destructive waves, so if anything you’d actually reduce reflections back out into the world.