News for hackers. Stuff that matters.

A comment on OpenAI. Parent comment

Re:OpenAI by deadpannini on Saturday June 18, 2022 @01:05PM (#31791706)
I don't intend to forbid anything - I just think the language of motivation and desire makes it harder to see the risks, because it introduces irrelevant questions into the the conversation like "how can machines want something?"

Conversely, at least in this discussion, the term "intelligence" seems pretty neutral.

[ Parent | on HN ]
Re:OpenAI by tome on Saturday June 18, 2022 @02:36PM (#31792510)
> I just think the language of motivation and desire makes it harder to see the risks, because it introduces irrelevant questions into the the conversation like "how can machines want something?"

Yet discourse on existential AI risks is predicated on something like a "goal" (e.g. to maximise paperclips). Notions like "goal" also make it harder to see clearly what we are actually discussing.

> the term "intelligence" seems pretty neutral

Hmm, I'm not convinced. It seems like an extremely loaded term to me.

[ Parent | on HN ]
Re:OpenAI by deadpannini on Saturday June 18, 2022 @05:22PM (#31793946)
AIs absolutely do have goals, determined by their reward functions.

Yes, "intelligence" is a deeply loaded term. It just doesn't matter in the context of the discussion here, so far as I've seen.its ambiguities haven't been relevant.

[ Parent | on HN ]
Re:OpenAI by astrange on Saturday June 18, 2022 @06:25PM (#31794351)
> AIs absolutely do have goals, determined by their reward functions.

You're confusing "AIs" (existing ML models) with "AGIs" (theoretical things that can do anything and are apparently going to take over the world). Not only is there not proof AGIs can exist, there isn't proof they can be made with fixed reward functions. That would seem to make them less than "general".

[ Parent | on HN ]
Re:OpenAI by eru on Monday June 20, 2022 @03:44AM (#31807389)
Compare https://www.gwern.net/Tool-AI
[ Parent | on HN ]