It doesn't matter whether we can see those dark orbiting bodies: we observe minuscule gravitational impact on the stars, and that places a very sharp upper limit on the amount of mass that's outside of the star in a solar system.

The sun contains roughly 99.8% of the mass of the solar system, and is by far the largest object in it. But you wouldn't hit the sun randomly either. Space is just so damn large.