Re:AI behavior guardrails should be public
by didntcheck on Wednesday February 21, 2024 @04:23PM
(#39459743)
I see it as not unlikely that there'll be a campaign to sigmatize, if not outright ban, open source models on the grounds of "safety". I'm quite surprised at how relatively unimpeded the distribution of image generation models has been, so far
Re:AI behavior guardrails should be public
by int_19h on Wednesday February 21, 2024 @05:33PM
(#39460557)
This is already happening, actually, although the focus so far has been on the possibility of their use for CSAM:
https://www.theguardian.com/society/2023/sep/12/paedophiles-...
Re:AI behavior guardrails should be public
by AlanYx on Thursday February 22, 2024 @05:00AM
(#39465167)
What you're predicting has already started. Two weeks ago Geoffrey Hinton gave a speech advocating banning open source AI models (see e.g.: https://thelogic.co/news/ai-cant-be-slowed-down-hinton-says-... ).
I'm surprised there wasn't an HN thread about it at the time.
Re:AI behavior guardrails should be public
by photoGrant on Wednesday February 21, 2024 @03:39PM
(#39459197)
Absolutely it won't. We've armed the issue with a supersonic jet engine and we're assuming if we build a slingshot out of pop sticks we'll somehow catch up and knock it off course.
Re:AI behavior guardrails should be public
by chasd00 on Wednesday February 21, 2024 @03:53PM
(#39459404)
i can't predict the future but there is precedent. Models, weights, and dataasets are the keys to the kingdom like operating system kernels, databases, and libraries use to be. At some point, enough people decided to re-invent and release these things or functionality to all that it became a self-sustaining community and, eventually, transformative to daily life. On the other hand, there may be enough people in power who came from and understand that community to make sure it never happens again.
Re:AI behavior guardrails should be public
by photoGrant on Wednesday February 21, 2024 @03:57PM
(#39459443)
No, compute is keys to the kingdom. The rest are assets and ammunition. You out-compute your enemy, you out-compute your competition. That's the race. The data is part of the problem, not the root.
These companies are silo'ing the worlds resources. GPU, Finance, Information. Those combined are the weapon. You make your competition starve in the dust.
These companies are pure evil pushing an agenda of pure evil. OpenAI is closed. Google is Google. We're like, ok, there you go! Take it all. No accountability, no transparency, we trust you.
Re:AI behavior guardrails should be public
by CuriouslyC on Wednesday February 21, 2024 @04:09PM
(#39459590)
Compute lets you fuck up a lot when trying to build a model, but you need data to do anything worth fucking up in the first place, and if you have 20% of the compute but you fuck up 1/5th as much you're doing fine.
Meta/OpenAI/Google can fuck up a lot because of all their compute, but ultimately we learn from that as the scientists doing the research at those companies would instantly bail if they couldn't publish papers on their techniques to show how clever they are.
Re:AI behavior guardrails should be public
by photoGrant on Wednesday February 21, 2024 @04:12PM
(#39459626)
I never said each of these exist in a vacuum. It is the collation of all that is the danger. This isn't democratic. This is companies now toying with governmental ideologies.
opensource models and training sets. So basically the "secret sauce" minus the hardware. I don't see it happening voluntarily.