News for hackers. Stuff that matters.
Re:How 'Open' Is OpenAI, Really? by fenomas on Monday March 13, 2023 @01:51AM (#35131645)
TFA claims GPT-2 isn't open. Is it that the trained weights are open but the project that did the training isn't?
Re:How 'Open' Is OpenAI, Really? by alwayslikethis on Monday March 13, 2023 @03:53AM (#35132466)
Realistically the most difficult part of training a LLM is curating a good data set. OpenAI never published their training data.