News for hackers. Stuff that matters.
Re:Sam and Greg's response to OpenAI Safety researcher claims by 0xDEAFBEAD on Tuesday May 21, 2024 @12:52AM (#40424283)
>When it comes to AI we have just a lone detached brain, not in control over anything, so that it cannot even "fire" by itself: someone has to provide its inputs.

By assumption, this AI has already been created, so presumably someone is willing to do that -- and given its superhuman manipulation abilities, their willingness will probably not change.

Re:Sam and Greg's response to OpenAI Safety researcher claims by blksv on Wednesday May 22, 2024 @04:16AM (#40438571)
Then, AI's abilities are effectively limited by those of this malicious operator who has to understand and perform what the AI suggests and feed back the results.
Re:Sam and Greg's response to OpenAI Safety researcher claims by 0xDEAFBEAD on Thursday May 23, 2024 @12:43AM (#40450551)
Not true for a couple reasons:

* If the malicious operator has a superhuman advisor, that will increase their ability

* If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely

The broader point is: abandon wishful thinking and actually consider the possibility of a worst-case scenario

Re:Sam and Greg's response to OpenAI Safety researcher claims by blksv on Thursday May 23, 2024 @03:06PM (#40458622)
> If the malicious operator has a superhuman advisor, that will increase their ability

Only when it comes to information processing. The inputs may (and will) be incomplete, incorrect, ambiguously formulated... The outputs may (and will) be misunderstood. And misunderstood instructions may (and will) be poorly performed.

> If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely

What one man has connected, some other always can disconnect... And not anything is on the internet.

> abandon wishful thinking and actually consider the possibility of a worst-case scenario

The problem with all those scenarios is equating superintelligence with omniscience and omnipotence, which is plain wrong. Physics matters.