Yes it’s “elitist”, but it’s the equivalent of expecting someone qualified to perform a heart surgery rather than a rando off the street.
(You do need the random lottery version of DD, sortition, rather than the everyone gets to vote on everything type).
And moreover, we can't trust each other fully. We can try to aspire to it, but none of us can honestly say we just want what's best for everyone.
Just because someone is smarter than you by some measure, doesn't mean you're better off letting them rule you.
> We can try to aspire to it, but none of us can honestly say we just want what's best for everyone.
This is exactly why having anything approaching a ruling class is a large hazard to avoid. Intermediate steps between citizens voting and power being executed are an attack area for people with selfish interests to inject themselves.
The truth is half of the population is dumber than the average, but the other half is smarter than average. Groups of people are susceptible to bias just like individuals. At least when people vote we know they are considering their own interests.