News for hackers. Stuff that matters.
Re:Banning Open Weight Models Would Be a Disaster by ben_w on Tuesday April 02, 2024 @08:02AM (#39904775)
> with sufficient money and hardware

Is making an assumption that hardware is not also facing restrictions.

> code and data is practically available

Disagree; although the base model data is, the RLHF data isn't.

This is also why 3rd parties are not able to replicate Google, despite all the PageRank patents having expired and the web being about as crawlable for Google as for, say, Bing.

> "median CS grad-student"

… is how I regard the quality of ChatGPT's code output, FWIW.

Re:Banning Open Weight Models Would Be a Disaster by skissane on Tuesday April 02, 2024 @08:19AM (#39904884)
> the RLHF data isn't

There are open sources of RLHF data - for example, the LMSys Chatbot Arena dataset (for same prompt two different responses along with which the human preferred), ShareGPT

It also isn’t hard to use existing leading AIs like GPT-4 or Claude-3 to generate synthetic RLHF datasets. They’ll put words in their terms of service to say you can’t use a dataset generated in that way to a train a competing model, but their ability to enforce those terms in practice is very open to question