News for hackers. Stuff that matters.
Re:Washington's Lottery forced to pull site after creating A... by hedora on Thursday April 04, 2024 @10:05AM (#39930563)
Regardless of their intentions, current state of the art automatic censorship have dangerously bad false positive and false negative rates. So, they inadvertently and inevitably suppress the truth and broadcast misinformation. Their performance on images is similarly bad.

Of course, even if they did work, centralizing control of them is a bad idea. The end user should have the freedom to control such things. (In the same way you can type swear words into a word processor).

Re:Washington's Lottery forced to pull site after creating A... by the_snooze on Thursday April 04, 2024 @10:21AM (#39930765)
In practice, these AI models are centralized services. Few people are running them locally on their machine with knowledge of the training data, weights, or system prompts. There isn't a direct line between "user intent" and "system output," unlike the local word processor in your example.

Someone has to make value judgments on the underlying data and algorithms, if only to build the system in the first place. If users can't (or don't care to) run these models locally, who else will decide other than the service operator?

Re:Washington's Lottery forced to pull site after creating A... by jameshart on Thursday April 04, 2024 @10:22AM (#39930775)
‘The censorship work done in AI alignment is insufficiently accurate to rely on for production use’ is a good and valid position

‘Therefore AI vendors should release uncensored models and let everyone else figure it out’ is not a logical consequent from it.

‘Therefore don’t use current AI tech to build apps that photomanipulate user submitted content and echo the results back to them with your logo on it’ would be a more logical conclusion to draw.

Re:Washington's Lottery forced to pull site after creating A... by Fubarberry on Thursday April 04, 2024 @10:25AM (#39930826)
Thankfully that is how a lot of AI is working right now, open source models for both LLM and Stable Diffusion let people have access to uncensored reasonably decent quality AI tools.

In other categories of AI generated content though, such as speech and music, the open source alternatives are either lacking or completely absent. And with the company behind Stable Diffusion being on the verge of financial collapse, we may see Stable Diffusion fall far behind it's closed source counterparts.