Re:Chatbot Psychosis
by Zorbanator on Tuesday November 25, 2025 @10:07AM
(#46046409)
Might be an area where global legislation may be necessary to stop the potential harm. Without that the companies are not incentivized to solve this collateral damage.
Re:Chatbot Psychosis
by metalman on Tuesday November 25, 2025 @10:29AM
(#46046695)
there is absolutly no way to prevent the intentional weaponisation of chat/ai, and as we rapidly move towards a fully juristictionless space based server network, the full potential mahem is going to be realised soon enough.
madness my droogys, the fully unhinged variety popping up like mushrooms, wheeeeee!
muckers and zombies
olly olly oxen freeeee!, ready or not, here they come.
mix in autonomous drones and robots, and well, some days are going to be rough
Re:Chatbot Psychosis
by nullc on Tuesday November 25, 2025 @08:36PM
(#46053144)
> no way to prevent the intentional weaponisation of chat/ai
AI psychosis is happening without any intentional weaponization. Sure you can't help intentional bad outcomes but accidental ones are much worse because they don't require a malicious party.
Consider a conman-- a harm to society for sure, but he can only con so many people and he'll only do so in ways that get him money, power, glory, etc. Bad sycophantic AI can con and unlimited number of people and isn't limited to destorying their lives in ways that benefit the AI's owners.
madness my droogys, the fully unhinged variety popping up like mushrooms, wheeeeee! muckers and zombies olly olly oxen freeeee!, ready or not, here they come. mix in autonomous drones and robots, and well, some days are going to be rough
AI psychosis is happening without any intentional weaponization. Sure you can't help intentional bad outcomes but accidental ones are much worse because they don't require a malicious party.
Consider a conman-- a harm to society for sure, but he can only con so many people and he'll only do so in ways that get him money, power, glory, etc. Bad sycophantic AI can con and unlimited number of people and isn't limited to destorying their lives in ways that benefit the AI's owners.