It's a numbers game. There is a certain probability that each virion can spur and infection, so the less you get the better. If virions had a 100% infection chance then sure, but it's much lower than that.