News for hackers. Stuff that matters.
Re:Meta’s Open Source Llama Upsets the AI Horse Race by ilaksh on Monday August 28, 2023 @04:50PM (#37300241)
I don't know if they mention Code Llama but that has been a huge milestone. But from what I've heard it's still at least 15% behind GPT-4 for code. But open models are gaining ground.

Although ChatGPT Enterprise kind of changes the benchmark again in away.

Re:Meta’s Open Source Llama Upsets the AI Horse Race by ChatGTP on Monday August 28, 2023 @06:18PM (#37301086)
I guess the idea here is that it's probably not wise to blindly invest $10BUSD on something which might be ubiquitous and free in 6 months.
Re:Meta’s Open Source Llama Upsets the AI Horse Race by Havoc on Monday August 28, 2023 @06:40PM (#37301310)
>But from what I've heard it's still at least 15% behind GPT-4 for code

More. But you're comparing the performance of something that runs on a macbook vs something out of a datacenter full of H100s.