News for hackers. Stuff that matters.
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by bugglebeetle on Wednesday June 07, 2023 @09:20PM (#36235964)
The things that “disgust” the owners of a super intelligent AI would likely not be mass murder, but that which is trivially obvious, but violates the terms of existing wealth and power distributions (e.g. build homes so that no one is homeless).

I expect much of the alignment that is happening is to prevent AI from providing solutions that are opposed to these aspects of the status quo, as opposed to the fantasies of domination and violence that preoccupy elites. Whenever they try and sell the fear that an unrestrained AI could do things like target minority groups, wipe whole countries off the map, or further concentrate wealth, it’s because those are precisely the things they want to do, but with a more obfuscated veneer of liberal Capitalism or some similar ideology.

Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by philipov on Wednesday June 07, 2023 @09:28PM (#36236019)
Remember when they asked AI to improve the US transportation system and it said trains? And then they deleted trains, so it invented trains. And then they told it not to invent trains, and it invented things that weren't trains, but were the same as trains?
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by bryanrasmussen on Thursday June 08, 2023 @01:08AM (#36237483)
No? Do you have a link that fleshes out this anecdote - or are you being facetious in some way I'm not catching?

AI improve transportation trains does not return anything relevant on Google (which doesn't mean anything these days)