News for hackers. Stuff that matters.
Re:Ask HN: What is the apocolyptic scenario for AI “breaking... by dragonwriter on Friday April 14, 2023 @01:18PM (#35572036)
> What if you combine those with an LLM that has been prompted to take over every machine on the planet?

Or, without a melodramatically villainous human action in the mix, one which has been prompted to perform some innocuous task, but given inadequate safeguards, and for which it reasons (perhaps accurately, with the paramters it has been given) taking over every other computer will be useful in more efficiently carrying out.

Re:Ask HN: What is the apocolyptic scenario for AI “breaking... by ifyoubuildit on Friday April 14, 2023 @01:20PM (#35572071)
Right, good point, the innocuous case is probably most likely. Either way, once it happens, incredible amounts of damage would be done very quickly.
Re:Ask HN: What is the apocolyptic scenario for AI “breaking... by yeck on Saturday April 15, 2023 @02:08PM (#35583027)
Accidents are a big risk, but don't underestimate the number of individuals and small groups that have fundamentally anti-social philosophies. I think of groups like antinatalists, doomsday religious groups, traditional terrorist orgs. There is even a sort of post-human futurist that sees humanity's purpose being to create a great super intelligence to replace us (may be overlap with this group and antinatalists).

So, I think there we be more chances for legit accidents, but also some motivated people intentionally trying to cause harm.