Well, duh, then there's more room for doubt.

Look, we're talking about the difference between opinion and fact here. By its very nature, "fact" implies that you have enough evidence already that questioning that fact requires evidence of its own. If I hold some weaker opinion, then sure, it's entirely reasonable to hold an opinion contrary to that without the burden of proof immediately being on you.