What you’re describing is Bayesian inference in action. Given how rare big interstellar comets should be, and how common small ones should be, the lack of detections makes the big-comet hypothesis incredibly unlikely. So we update our beliefs: it’s probably small. Space statistics at work