Put it another way. If your immune system recognizes the virus already, it matters little whether you get one droplet or a thousand, it will beat it because it has a several-day head start in doing so.
If, on the other hand, your immune system does not already recognize it, then it will not begin to see the problem, and thus will not begin to react, until it has replicated up to a large amount, where "large" is some amount greater than either one droplet or one thousand will give you. So, the consequences of getting exposed to 1/2 or 1/10 of the number of copies of the virus, is basically nil, because an exponential rise will be needed in either case to get up to the level where your immune system notices a problem.
Either your immune system already recognizes the virus as a problem, or it doesn't. I neither case does the dose matter, so long as the dose is big enough to start the process. And that probably doesn't take much.
These probably aren't independent, and are occurring at the same time. So while a very small amount of virus is replicating, the immune system is mounting a defense, slowing down that replication. The virus may never get to a significant amount (although the immune response might knock you on your ass.)
On the other hand, if you start with a ton of virus already, you'll be dealing with the immune response and the direct effects of the virus at the same time, and the virus may overwhelm or even limit the immune response.