Which is what the Founding Fathers intended. The word “democracy” does not exist anywhere in the Constitution or Declaration of Independence. As Ben Franklin put it, we have a republic, if we can keep it. We have done a terrible job at that.
Even if that was true (and most generalizations about the Founding Father's aren't because they were a diverse group with often diametrically opposed intentions), “what the Founding Father's intended” (other than some role in the legal interpretation of text of laws written by them, including the Constitution) ought not have any special weight.
But I disagree that this particular discourse is in the tradition of the founding fathers' concerns about popular opinion.
Their project to prevent "the unwashed masses" from expressing themselves came in the form of limiting enfranchisement to white man with property. They would have vehemently disagreed with the idea that those propertied white men should worry a lot about being ignorant and only vote if they were sure they had properly prepared!
Even the one part that was supposed to be actually representative isn't.
Start over. No more senate. Elected president. Representative parliament.
I think this understanding is common, but it's totally incorrect and is part of the larger project to get fewer people to vote.
Voting does represent, in some sense, a decision of import for how society functions. A vote for a tyrant, for example, would be bad for everyone. But is voting more important or influential than the many, many other ways in which people support or oppose bad things in our society?
In the same domain - political donations support or oppose the same politicians (and the relative impact of a donation and a vote is debatable - at the very least people can donate many times!), but the discourse around them has none of the concern around "poorly informed" donators. In a different domain - working for a company can have an enormous good or bad impact on the world, but we don't caution people against "ignorantly" accepting a position (there is lots of discussion around the morality of companies - but people are not called "irresponsible" or "ignorant" simply for working for bad companies).
I would ask you to consider how big an impact a vote has and compare that any other decision we make that impacts the world. The narrative you're advancing holds voting to a much higher standard than other ways in which people affect the world. I personally think this is because the originators of this argument (but not necessarily you) want people to question if they should vote. However, they would never suggest that a person their suitability to select who to buy services from, or work for, or donate money to - because those are all actions taken by higher-income people and voting is (or attempts to be) universal.