Well there's the problem. What do you do when you have ballots that are objectively unclear, like the infamous butterfly ballot? You can't invalidate the election and have a new one--apart from the logistical problems, the turnout is going to differ significantly based on the media attention and the knowledge that the cancelled ballots were so close.
The best option you have is to mandate judicial review of ballots well before the election. But even that doesn't save you in the situation Florida actually found itself in.
I saw a reproduction of this ballot in the newspaper at the time and I remember wondering what the problem was supposed to be. It seemed perfectly clear, but journalists were jumping on the bandwagon of calling it confusing.
Scalia's suggestion was that if a vote couldn't be read by a machine, it wasn't a legitimate vote regardless of any extenuating details. That may have been influenced by the fact that Florida law only mentioned recounts that were performed by running the ballots through the machines a second time.
Florida law at the time only mentioned recounts in the context an automatic recount that involved putting the ballots back through the same machines a second time.
Gore's legal team asked for hand recounts, and suggested the "clear intent of the voter" standard. Scalia asked whether the standard should be "can be read by a machine," given that Florida statutes only mentioned recounts that involved machines.
If you still disagree, how would you answer my earlier question: I walk into a polling place, announce my name, clearly yell who I want to vote for, and leave. My intent is clear, should my vote count?
What if I were to mail in a ballot, that wasn't postmarked? My intent was clear, but Gore requested that such ballots not be counted. What does the postmark have to do with intent? Or is intent a necessary, but not sufficient, element?
For the record, the last time I filled out a paper ballot (Calinornia, late '90s), they handed me a special marker and told me to use it, or my vote would not count (they also told me not to mark two spots for the same office, or my vote would not count).
However, "is readable by a machine" is not a well-defined standard, and is IMO way too strict; it's more than likely that a panel of human readers would all agree on which name is written on a ballot, without it being readable by a machine.
But it's also not as rigorous as it should be. Two machines may disagree on how readable a particular ballot is, even if both machines are operating within specified tolerances.