Jan Leike joins Anthropic on their superalignment team

Re:Jan Leike joins Anthropic on their superalignment team by thefaux on Tuesday May 28, 2024 @01:28PM (#40503162)

Is this not something of an oxymoron? If there exists an ai that is more intelligent than humans, how could we mere mortals hope to control it? If we hinder it so that it cannot act in ways that harm humans, can we really be said to have created superintelligence?

It seems to me that the only way to achieve superalignment is to not create superintelligence, if that is even within our control.

[ Parent | on HN ]

Re:Jan Leike joins Anthropic on their superalignment team by whimsicalism on Tuesday May 28, 2024 @01:30PM (#40503189)

Many people share your views, but others believe it is possible.

[ Parent | on HN ]

Re:Jan Leike joins Anthropic on their superalignment team by renewiltord on Tuesday May 28, 2024 @01:35PM (#40503254)

Not self-evident. Fungus can control ant. Toxoplasma gondii can control human. Who is more intelligent? So if control of more intelligent being is possible, could it be symbiotic to permit? Alpha-proteobacteria sister to ancestor proto-mitochondria and now we live aligned. But those beings lacked conscious agency. We have more than them. Not self-evident we will fail at this.

[ Parent | on HN ]

Re:Jan Leike joins Anthropic on their superalignment team by dr_dshiv on Tuesday May 28, 2024 @01:50PM (#40503429)

Another example is the alignment between our hindbrain, limbic system and neocortex. Neocortex is smarter but is usually controlled by lower level processes…

Note that misalignment between these systems is very common.

[ Parent | on HN ]