News for hackers. Stuff that matters.
Re:The Myth of a Superhuman AI by bjornsing on Wednesday August 25, 2021 @04:03PM (#28306216)
Only skimmed the bullet points, but one that’s missing and seems important to me is:

* The marginal utility of intelligence may not be so great. If you are already really smart, is there any point to being smarter?

Most interesting problems are NP-complete. If you are really smart you can solve a big NP-complete problem. But how much smarter do you need to be to solve a slightly bigger (and therefore more interesting) problem? Well, twice as smart or something. Being just a little bit smarter gets you nothing. So (in this case) the marginal utility of intelligence approaches zero as your AI gets more intelligent.

Re:The Myth of a Superhuman AI by kbelder on Wednesday August 25, 2021 @07:03PM (#28308310)
Being 10% smarter puts you just marginally ahead of other people; and a competitive marginal advantage is often major.

So I'd say there's great utility in an AI being smarter than any human... and then the returns diminish.