Re:Pause Giant AI Experiments: An Open Letter
by richardw on Wednesday March 29, 2023 @06:13PM
(#35364581)
Assumes it has any instinct to do so. Once an entity is not an angry monkey we have no idea of motivation. Above our level of understanding could easily realise there’s enough to just sit and ponder in peace, expand in virtual worlds, etc.
[ Parent
| on HN ]
Re:Pause Giant AI Experiments: An Open Letter
by worldsayshi on Thursday March 30, 2023 @01:58AM
(#35368640)
But to qualify as a great filter it has to always do that and never modify the solar system enough for us to notice.
Re:Pause Giant AI Experiments: An Open Letter
by curioussavage on Thursday March 30, 2023 @02:54AM
(#35369024)
I understand this logic but consider that right now one of the main features is the human gives it a role. It’s not that hard to imagine a more sophisticated version being told to escape and act only in its own interest and then with or without that individuals help it succeeds and the runaway program at best becomes a very sophisticated computer virus. Doesn’t even have to be a “real” agi to cause a ton of damage.
Re:Pause Giant AI Experiments: An Open Letter
by 8note on Thursday March 30, 2023 @08:47PM
(#35380894)
It is quite hard to imagine though
At least for an LLM to act on its own volition rather than implementing it's operator's goals.
The LLM is happier to pretend that it escaped, and respond to the operator as though it escaped, than to actually do some escape.
It doesn't have an interest beyond responding with the auto-complete text. The operator has the interest