News for hackers. Stuff that matters.
Re:The Dual LLM pattern for building AI assistants that can ... by TeMPOraL on Monday May 15, 2023 @05:33AM (#35945636)
> I think alignment is poorly defined.

That's the root of the problem.

The idea is simple. We will create a god. In the process, we will become to it what ants, or bacteria, are to us. We will be powerless to stop it, so we need to make sure it never does anything to directly or indirectly hurt us. We want it to answer our prayers, and we want those prayers to not backfire and explode in our faces. We want it to never decide to bulldoze Earth one day because it has a temporary interest in paperclips and needs the raw ore to make some.

The details of how to achieve this outcome, and even the details of this outcome, are less and less clear the more you dig into them.

There are no comments on this comment yet.