I could see it as possible. The spread is asymmetric. You could have one infected person who is not a super spreader only infect a few other people who just happen to be asymptomatic and not spread it to others. When your overall infected population is very small, like in the beginning of a jump from animals to humans, then you have a chance to get lucky in this way. Once you get to a larger infected population (like dozens of people) then you're more likely to have a super spreader and less likely to get lucky with only contacting asymptomatic people.