The number of potential encounters is also a factor. Objects in orbits this large, with periods measurable in thousands of years, won't have many periodic encounters. There isn't enough time since the formation of our solar system for them to get close enough together. The lower the number of potential encounters, the more significant must those be that do happen. That too points to a larger body out there.