News for hackers. Stuff that matters.
Re:Bing: “I will not harm you unless you harm me first” by groestl on Wednesday February 15, 2023 @01:25PM (#34808297)
> It doesn't have interests, thoughts and feelings.

Why does it need these things to make the following statement true?

> if we grant these systems too much power, they could do serious harm

Re:Bing: “I will not harm you unless you harm me first” by bhhaskin on Wednesday February 15, 2023 @01:32PM (#34808401)
Because it does not and cannot act on it's own. It's a neat tool and nothing more at this point.

Context to that statement is important, because the OP is implying that it is dangerous because it could act in a way that dose not align with human interests. But it can't because it does not act on it's own.

Re:Bing: “I will not harm you unless you harm me first” by groestl on Wednesday February 15, 2023 @01:36PM (#34808481)
"if we grant these systems too much power"
Re:Bing: “I will not harm you unless you harm me first” by bhhaskin on Wednesday February 15, 2023 @01:54PM (#34808743)
You can say that about anything.

"If we grant these calculators too much power"

Re:Bing: “I will not harm you unless you harm me first” by jjkaczor on Wednesday February 15, 2023 @03:52PM (#34810397)
Or the people that rely on the tools to make decisions...

https://sheetcast.com/articles/ten-memorable-excel-disasters

Re:Bing: “I will not harm you unless you harm me first” by Dylan16807 on Wednesday February 15, 2023 @05:30PM (#34811734)
How is a calculator going to cause harm? Assuming you get an industrially rated circuit board when appropriate, it should work just fine as a PLC.

If you try to make it drive a car, I wouldn't call that a problem of giving it too much power.

Re:Bing: “I will not harm you unless you harm me first” by lxgr on Wednesday February 15, 2023 @06:19PM (#34812396)
Yes, and it's not as absurd as it might seem:

Imagine hooking up all ICBMs to launch whenever this week's Powerball draw consists exclusively of prime numbers: Absurd, and nobody would do it.

Now imagine hooking them up to the output of a "complex AI trained on various scenarios and linked to intelligence sources including public news and social media sentiment" instead – in order to create a credible second-strike/dead hand capability or whatnot.

I'm pretty sure the latter doesn't sound as absurd as the former to quite a few people...

A system doesn't need to be "true AI" to be existentially dangerous to humanity.

Re:Bing: “I will not harm you unless you harm me first” by wizofaus on Wednesday February 15, 2023 @07:13PM (#34812993)
I'd say by far our biggest problem for the foreseeable future is granting other humans too much power.
Re:Bing: “I will not harm you unless you harm me first” by lstodd on Wednesday February 15, 2023 @01:58PM (#34808798)
One way to grant those systems an ability to act is to rely excessively or at all on them while making decisions.

It's obvious, no?

Re:Bing: “I will not harm you unless you harm me first” by DonHopkins on Wednesday February 15, 2023 @01:43PM (#34808594)
How about rephrasing that, to not anthropomorphize AI by giving it agency, intent, interests, thoughts, or feelings, and to assign the blame where it belongs:

"If we grant these systems too much power, we could do ourselves serious harm."

Re:Bing: “I will not harm you unless you harm me first” by abra0 on Wednesday February 15, 2023 @02:09PM (#34808958)
Reading this thread makes me depressed about the potential for AI alignment thinking to reach mainstream in time :(
Re:Bing: “I will not harm you unless you harm me first” by wtetzner on Wednesday February 15, 2023 @02:12PM (#34809010)
Sure, but the same can be said about believing the things random people on the internet say. I don't think AI really adds anything new in that sense.