How 'Open' Is OpenAI, Really?

Re:How 'Open' Is OpenAI, Really? by scottydog51834 on Monday March 13, 2023 @01:41AM (#35131569)

GPT-2

Here is one cool (and recent) research project using GPT-2 model weights.

[ Parent | on HN ]

Re:How 'Open' Is OpenAI, Really? by fenomas on Monday March 13, 2023 @01:51AM (#35131645)

TFA claims GPT-2 isn't open. Is it that the trained weights are open but the project that did the training isn't?

[ Parent | on HN ]

Re:How 'Open' Is OpenAI, Really? by alwayslikethis on Monday March 13, 2023 @03:53AM (#35132466)

Realistically the most difficult part of training a LLM is curating a good data set. OpenAI never published their training data.

[ Parent | on HN ]