News for hackers. Stuff that matters.
Re:Talk-Llama by nwoli on Thursday November 02, 2023 @07:14AM (#38111787)
A few months until this is effectively outlawed if the open weights proposal in 270 days comes into existence
Re:Talk-Llama by turned-upright on Thursday November 02, 2023 @07:57AM (#38112245)
Can you elaborate please?
Re:Talk-Llama by eurekin on Thursday November 02, 2023 @08:09AM (#38112378)
Re:Talk-Llama by tyler33 on Thursday November 02, 2023 @08:42AM (#38112712)
we just have to download the weights and use piratebay, or even emule, just like old times
Re:Talk-Llama by eurekin on Thursday November 02, 2023 @08:57AM (#38112861)
Yes, but companies will have no incentive to publish open source models anymore. Or, it could be so difficult/beaurocratic no one will bother and keep it close source
Re:Talk-Llama by moralestapia on Thursday November 02, 2023 @09:59AM (#38113598)
What will actually happen is that innovation there will just move somewhere else (and it has partly done so).

This proposal is the US doing that bicycle/stick meme, it will backfire spectacularly.

Re:Talk-Llama by lukeschlather on Thursday November 02, 2023 @10:24AM (#38113929)
The innovation is largely happening within the megacorps anyway, this is solely intended to make sure the innovation cannot move somewhere else.
Re:Talk-Llama by eurekin on Thursday November 02, 2023 @11:52AM (#38115279)
Still, one of those corporations wants to capture the market and has monopolistic attitude. Meta clearly chose the other direction, when publishing their models and allowing us all to participate in.
Re:Talk-Llama by v3ss0n on Thursday November 02, 2023 @12:51PM (#38116409)
Mistral and Falcon is not from megacorps and not even US.and many other opensource chinese models . And both are based models that means they are totally organic outside of US.
Re:Talk-Llama by renewiltord on Thursday November 02, 2023 @12:58PM (#38116530)
That’s what they told us. Turns out Google stopped innovating a long time ago. They could say stuff like this when Bard wasn’t out but now we have Mistral and friends to compare to Llama.

Now it turns out they were just bullshitting at Google.

Re:Talk-Llama by smoldesu on Thursday November 02, 2023 @01:36PM (#38117199)
> Now it turns out they were just bullshitting at Google.

I don't think Google was bullshitting when they wrote, documented and released Tensorflow, BERT and flan-t5 to the public. Their failure to beat OpenAI in a money-pissing competition really doesn't feel like it reflects on their capability (or intentions) as a company. It certainly doesn't feel like they were "bullshitting" anyone.

Re:Talk-Llama by renewiltord on Thursday November 02, 2023 @01:39PM (#38117251)
Everyone told us they had secret tech that they were keeping inside. But then Bard came out and it was like GPT-3. I don’t know man. The proof of the pudding is in the eating.

> The innovation is largely happening within the megacorps anyway

That was the part I was replying to. Whichever megacorp this is, it’s not Google.

Re:Talk-Llama by smoldesu on Thursday November 02, 2023 @02:02PM (#38117588)
Hey, feel free to draw your own conclusions. AI quality is technically a subjective topic. For what it's worth though, Google's open models have benched quite competitively with GPT-3 for multiple years now: https://blog.research.google/2021/10/introducing-flan-more-g...

The flan quantizations are also still pretty close to SOTA for text transformers. Their quality-to-size ratio is much better than a 7b Llama finetune, and it appears to be what Apple based their new autocorrect off of.

Re:Talk-Llama by krunck on Thursday November 02, 2023 @01:45PM (#38117356)
Then we'll create a distributed infrastructure for the creation of models. Run some program and donate spare GPU cycles to generate public AI tools that will be made available to all.
Re:Talk-Llama by eurekin on Thursday November 02, 2023 @03:24PM (#38118706)
I really really would like to believe this could work in practice.

Given current data volume used during the training phase (tb/s), I highly doubt it's possible without two, magnitude changing, breakthroughs at once

Re:Talk-Llama by infecto on Thursday November 02, 2023 @08:17AM (#38112453)
Soliciting Input on Dual-Use Foundation Models with Widely Available Model Weights. When the weights for a dual-use foundation model are widely available — such as when they are publicly posted on the Internet — there can be substantial benefits to innovation, but also substantial security risks, such as the removal of safeguards within the model. To address the risks and potential benefits of dual-use foundation models with widely available weights, within 270 days of the date of this order, the Secretary of Commerce, acting through the Assistant Secretary of Commerce for Communications and Information, and in consultation with the Secretary of State, shall...

I believe that is the relevant section, which I am hoping they realize how dumb this is going to be.

Re:Talk-Llama by eurekin on Thursday November 02, 2023 @08:30AM (#38112581)
This is huge news... Has anybody seen any discussions around that topic?
Re:Talk-Llama by akalajeu on Thursday November 02, 2023 @09:39AM (#38113364)
Re:Talk-Llama by infecto on Thursday November 02, 2023 @09:56AM (#38113570)
This is not a discussion, this is just you posting verbatim what the executive order said.
Re:Talk-Llama by btbuildem on Thursday November 02, 2023 @09:24AM (#38113186)
This exists solely to protect the incumbents (OpenAI et al)
Re:Talk-Llama by moralestapia on Thursday November 02, 2023 @09:56AM (#38113574)
OpenAI has truly lived up to its name!

Not even Oracle dared to pull shit like this w/ Java.

Re:Talk-Llama by pixl97 on Thursday November 02, 2023 @10:13AM (#38113790)
Eh, I may be misremembering my history, but didn't they try back in the day and quickly got smacked down for one reason or another?
Re:Talk-Llama by moralestapia on Thursday November 02, 2023 @06:08PM (#38120961)
They do defend their business, tooth and nail.

But this would be akin to them saying "you know, bytecode could be used for evil, and we'd to regulate/outlaw the development of new virtual machines like the one we already have".

Re:Talk-Llama by kgeist on Thursday November 02, 2023 @10:18AM (#38113852)
China and Russia will keep using US models because they don't care about US laws. I think if restrictions on AI are only applied in the US, such restrictions will only put Americans at a disadvantage.

P.S. I'm from one of the said countries

Re:Talk-Llama by eurekin on Thursday November 02, 2023 @11:21AM (#38114765)
I feel like this is another case of screens for e-book readers; where a single player had everybody else in a chokehold for decades, and slowed down innovation to a drip
Re:Talk-Llama by pmarreck on Thursday November 02, 2023 @11:12AM (#38114630)
> the removal of safeguards within the model

this cat is already out of the bag, so this is pointless legislation that just hampers progress

I have already had good-actor success with uncensored models

Re:Talk-Llama by dragonwriter on Thursday November 02, 2023 @05:20PM (#38120328)
> this cat is already out of the bag, so this is pointless legislation that just hampers progress

This isn't legislation.

And its not proposing anything except soliciting input from a broad range of civil society groups and writing a report. If the report calls for dumb regulatory ideas, that’ll be appropriate to complain about. But “there’s a thing that is happening that seems like it might have big effects, gather input from experts and concerned parties and then writeup findings on the impacts and what, if any, action seems warranted is... not a particularly alarming thing.

Re:Talk-Llama by pmarreck on Thursday November 02, 2023 @05:38PM (#38120564)
OK. The way it was portrayed is that this was "very bad" so I assumed something was decreed without sufficient input from the industry/community.
Re:Talk-Llama by chasd00 on Thursday November 02, 2023 @04:55PM (#38120013)
> removal of safeguards within the model

This is insanity. I have to be missing something, what else do the safeguards prevent the LLM from doing? This has to be more about this than like preventing an LLM from using bad words or showing support for Trump...

Re:Talk-Llama by dragonwriter on Thursday November 02, 2023 @05:13PM (#38120241)
> I believe that is the relevant section, which I am hoping they realize how dumb this is going to be.

How dumb its going to be to... solicit input from a wide range of different areas and write a report?

Re:Talk-Llama by ilaksh on Thursday November 02, 2023 @10:22AM (#38113896)
I don't see anywhere that it says weights are outlawed. The part I saw says something about making a report on risks or benefits of open weights.

I agree that it is concerning the way it's open-ended. But where is the actual outlawing?

Re:Talk-Llama by davepeck on Thursday November 02, 2023 @10:29AM (#38113985)
This assertion is not supported by the text of Biden’s Executive Order. There are a number of requirements placed on various government agencies to come up with safety evaluation frameworks, to make initial evaluations related to open weight models, and to provide recommendations back to the President within 270 days. But there’s nothing whatsoever that I can find that outlaws open weight models. There’s also little reason to think that “outlaw them” would be amongst the recommendations ultimately provided to the executive.

(I can imagine recommendations that benefit incumbents by, for instance, placing such high burden on government adoption of open weight models that OpenAI is a much more attractive purchase. But that’s not the same as what you’re talking about.)

I dunno, the EO seems pretty easy to read. Am I missing something in the text?

https://www.whitehouse.gov/briefing-room/presidential-action...

Re:Talk-Llama by s1gnp0st on Thursday November 02, 2023 @10:59AM (#38114412)
Yeah, they're not going to outlaw them. The well-worn path is to make the regulatory burden insurmountable for small companies; that will be enough.

Disobey.

Re:Talk-Llama by renewiltord on Thursday November 02, 2023 @12:56PM (#38116496)
How does one provide the KYC information for open models?
Re:Talk-Llama by selfhoster11 on Thursday November 02, 2023 @03:10PM (#38118522)
More to the point, why in the world should anyone "know" me to download a file? A simple antithesis of open technology, that's what this proposal is.
Re:Talk-Llama by dragonwriter on Thursday November 02, 2023 @07:02PM (#38121615)
Nothing in the order requires KYC information for open models.
Re:Talk-Llama by pmarreck on Thursday November 02, 2023 @11:10AM (#38114595)
How seriously threatening is this? How can they enforce something this stupid without even consulting with industry leaders?
Re:Talk-Llama by wahnfrieden on Thursday November 02, 2023 @12:35PM (#38116128)
OpenAI has lobbied them among others, already.
Re:Talk-Llama by pmarreck on Thursday November 02, 2023 @05:40PM (#38120589)
I honestly can't blame OpenAI. They likely threw a huge amount of money at training and fine-tuning their models. I don't know how open-source will surpass them and not stay a second-tier solution without another huge generous event occurring like Facebook open-sourcing LLaMa
Re:Talk-Llama by ericd on Friday November 03, 2023 @01:01PM (#38131598)
It seems like we need a distributed training network where people can donate GPU time, but then any training result is automatically open.
Re:Talk-Llama by pmarreck on Sunday November 05, 2023 @02:28PM (#38154683)
Great idea!
Re:Talk-Llama by freedomben on Thursday November 02, 2023 @12:48PM (#38116352)
Oh they have. Many of the industry leaders are importuning them for this. For industry leaders this is a business wet dream. It's "regulatory capture" at its finest
Re:Talk-Llama by dragonwriter on Thursday November 02, 2023 @05:23PM (#38120357)
The only thing this directs is... consulting with a variety of groups, including industry, and writing a report based in that consultation.

So, literally, they can’t enforce it without consulting with industry, since enforcement is just sonewhat in the government holding someone else in government accountable for consulting with, among others, the industry.

Re:Talk-Llama by yeouch on Thursday November 02, 2023 @01:33PM (#38117142)
Common sense AI control NOW. Ban assault style GPUs
Re:Talk-Llama by oaththrowaway on Thursday November 02, 2023 @02:52PM (#38118295)
Nobody needs more that 4GB of VRAM
Re:Talk-Llama by kurisufag on Thursday November 02, 2023 @03:52PM (#38119081)
the laws were designed for the GPUs of 2020, there's no way they could have predicted what technology would come to.
Re:Talk-Llama by chasd00 on Thursday November 02, 2023 @04:42PM (#38119845)
> Common sense AI control NOW. Ban assault style GPU

That is beautiful, I made you a shirt. https://sprd.co/ZZufv7j