Every single person doesn't understand all the security aspects of today's paper & pen ballots, how they are secured before and after the day of voting, how they are transported from one location to another, how mail-in ballots get handled, etc.

There's no reason to require something that everyone can understand when talking about a different voting system.

IMHO, we should aim to build something (whether using physical machines or using cryptography/mathematical properties) that the various parties in a government can audit and recognize as secure and that leads to a larger portion of the population voting or a cheaper election process.

Whether people do understand something is very different from whether people can understand something.

While many people maybe aren't aware of the security mechanisms of a pen and paper election, essentially everyone can actually understand them if they feel the need to, and that is extremely important. You cannot resolve widespread distrust by putting a bunch of mathematicians on TV who tell the population that everything is fine.

We already have something that can be made secure, anonymous, and auditable, and yet is easy to understand and relatively inexpensive. It is pencil and paper ballots, with multiple interested parties observing the entire process.