Re:Llama 2 – Meta AI
by foobiekr on Tuesday July 18, 2023 @06:49PM
(#36780081)
There's no reason to believe this. The training time and cost is so substantial that they are almost certainly building their next release, but it isn't sitting there rotting.
[ Parent
| on HN ]
Much of that training time is RLHF, the absence of which does not make the model less capable of carrying out useful tasks (indeed, in case of GPT-4, it actually made the model slightly less capable).
Re:Llama 2 – Meta AI
by PeterStuer on Thursday July 20, 2023 @12:22PM
(#36802825)
OpenAI themselves have said they hat GPT-4 internally before they ever released the first version of ChatGPT.