News for hackers. Stuff that matters.
Re:Gavin Newsom vetoes SB 1047 by Vetch on Sunday September 29, 2024 @10:03PM (#41692788)
Cost per FLOP continues to drop on an exponential trend (and what bit flops do we mean?). Leaving aside more effective training methodologies and how that muddies everything by allowing superior to GPT4 perf using less training flops, it also means one of the thresholds soon will not make sense.

With the other threshold, it creates a disincentive for models like llama-405B+, in effect enshrining an even wider gap between open and closed.

Re:Gavin Newsom vetoes SB 1047 by pas on Monday September 30, 2024 @06:38AM (#41695611)
Why? Llama is not generated by some guy in a shed.

And even if it were, if said guy has such amount of compute, then it's time to use some of it to describe the model's safety profile.

If it makes sense for Meta to release models, it would have made sense even with the requirement. (After all the whole point of the proposed regulation is to get some better sense of those closed models.)

Re:Gavin Newsom vetoes SB 1047 by llamaimperative on Monday September 30, 2024 @08:36AM (#41696447)
Also the bill was amended NOT to extend liability to derivative models that the training company doesn’t have effective control over.
Re:Gavin Newsom vetoes SB 1047 by llamaimperative on Monday September 30, 2024 @08:36AM (#41696442)
Both thresholds have a system to be adjusted.