You would have gotten caught then. Signature matching doesn't appreciably increase the security of the election; It simply disenfranchises people based on a shoddy test.

Besides, the ballots have long been separated from their signatures. Suppose we take your numbers seriously: The solution is to re-run the election or to let Pelosi become President and run it next year. Letting legislatures choose the president because of FUD is incredibly dangerous.