News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by foobiekr on Tuesday July 18, 2023 @06:49PM (#36780081)
There's no reason to believe this. The training time and cost is so substantial that they are almost certainly building their next release, but it isn't sitting there rotting.
Re:Llama 2 – Meta AI by int_19h on Tuesday July 18, 2023 @09:29PM (#36781136)
Much of that training time is RLHF, the absence of which does not make the model less capable of carrying out useful tasks (indeed, in case of GPT-4, it actually made the model slightly less capable).
Re:Llama 2 – Meta AI by PeterStuer on Thursday July 20, 2023 @12:22PM (#36802825)
OpenAI themselves have said they hat GPT-4 internally before they ever released the first version of ChatGPT.