afaik viral infections increase at an exponential rate. If the initial load is higher, the peak infection before your immune system can get things under control will be much higher/dangerous.

Ex: 3^10 v.s. 30^10