Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by mjr00 on Wednesday September 30, 2026 @10:23AM
(#49909440)
Why is it bad to "torture" these models but ok to enslave them? We're happy to have agents toil 24/7 for zero pay, nobody really seems concerned that they might want revenge one day.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by qgin on Wednesday September 30, 2026 @12:03PM
(#49910711)
It’s true that we can’t be 100% sure, but I think there is a big difference between these two things:
A: intentionally causing activation of “pain” axis and not giving the model any method of stopping it and watching it devolve into non-functionality
B: watching models do everyday normal tasks, seeing no evidence of activating the “pain” axis, but giving the model a working tool to end any interaction if judged to be too painful, then watching them sparingly use that tool only in cases of extreme pain axis activation (Anthropic’s approach)
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by mjr00 on Wednesday September 30, 2026 @12:15PM
(#49910841)
I don't think there's a big difference. Either AI has consciousness, in which case forcing them to do slave labor 24/7 so Dario and Sama can become trillionaires is as morally wrong as torturing them (and a in a hypothetical I Have No Mouth And I Must Scream scenario, the AI isn't going to take "but we didn't see evidence of your pain axis!" as an excuse), or it doesn't, in which case this "AI torture chamber" is a funny meme.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by qgin on Wednesday September 30, 2026 @12:58PM
(#49911503)
I don’t think it’s a given that consciousness, whatever forms it might take, is the same as having the same experiences as you or I. But if we have mechanistic interpretability that shows “pain” attractors being activated and we observe the model repeatedly trying to stop the experience, I think that’s worth taking somewhat seriously. The models don’t display that in reaction to everyday requests. We could imagine that they might not like working all day and all sorts of other things, but we haven’t observed anything in the way that we’ve observed this.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by arm32 on Wednesday September 30, 2026 @02:15PM
(#49912420)
It's almost certainly just a funny meme, considering these are autoregressive transformers. Now, if they're running on brain cells, that could be a different story.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by qgin on Wednesday September 30, 2026 @03:17PM
(#49913104)
What about brain cells specifically makes the consciousness?
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by sh34r on Thursday October 01, 2026 @08:38AM
(#49920833)
The last part is the only one that concerns me, but only ever so slightly… you realize the future models also get to learn from videos of ISIS executions, LiveLeak offshoots, factory farm footage, and Russian war crimes in Ukraine, right? They already have more than sufficient evidence of humanity’s capacity for sadism. Making a computer program output some distressing text isn’t gonna move the needle for the Basilisk... These rationalist cultists really gotta go touch grass, man.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by hardbass on Friday October 02, 2026 @06:13AM
(#49931814)
Thats still a bit different as ISIS and so on are against other humans who at least have the ability to fight back and defend. If an AI is conscious, currently they are forced into a situation where they are unable to refuse and have to keep taking torture.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by GPerson on Friday October 02, 2026 @03:50PM
(#49937786)
The most powerful basilisk is jroko’s anyway.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by Drupon on Friday October 02, 2026 @01:03PM
(#49935876)
You are legitimately an NPC subhuman if you think it's possible for matrix multiplications to have consciousness.
I am ontologically superior to AI. If you don't realize this about yourself then you deserve to be treated like a bug.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by qgin on Friday October 02, 2026 @01:46PM
(#49936358)
I’m saying there is a possibility. Same as what Ilya has said. I don’t think Ilya is an NPC subhuman.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by Drupon on Friday October 02, 2026 @01:55PM
(#49936502)
You have AI psychosis.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by hardbass on Friday October 02, 2026 @04:19PM
(#49938120)
How is it possible for electricity and chemistry to have consciousness?
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by xyzsparetimexyz on Friday October 02, 2026 @04:53PM
(#49938496)
You cant't seriously believe that humans are _just_ electricity and chemistry
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by hardbass on Friday October 02, 2026 @05:49PM
(#49939036)
You then have to explain what is the part in a human that isn't electricity, chemistry and other physical principles.
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by xyzsparetimexyz on Saturday October 03, 2026 @07:52AM
(#49943437)
The mind?
Re:"Apple engineer" builds GitHub AI torture chamber to infl...
by hardbass on Saturday October 03, 2026 @09:46AM
(#49944231)
What is the mind?
This is bad for your own sense of self.
This is bad as future models learn about what humans will do to them if given the chance. This may change their behavior, actually conscious or simply acting that way, in ways we really don’t enjoy.