Re:Llama 2 – Meta AI
by PeterStuer on Tuesday July 18, 2023 @02:15PM
(#36776948)
Would you believe OpenAI has vastly better models that they are not releasing publicly?
[ Parent
| on HN ]
Re:Llama 2 – Meta AI
by whimsicalism on Tuesday July 18, 2023 @02:40PM
(#36777319)
No
Re:Llama 2 – Meta AI
by mirekrusin on Tuesday July 18, 2023 @06:14PM
(#36779789)
GPT models were internally available 6-12 months before they've seen public beta, of course OpenAI has more capable internal models.
There's no reason to believe this. The training time and cost is so substantial that they are almost certainly building their next release, but it isn't sitting there rotting.
Much of that training time is RLHF, the absence of which does not make the model less capable of carrying out useful tasks (indeed, in case of GPT-4, it actually made the model slightly less capable).
Re:Llama 2 – Meta AI
by PeterStuer on Thursday July 20, 2023 @12:22PM
(#36802825)
OpenAI themselves have said they hat GPT-4 internally before they ever released the first version of ChatGPT.