News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by jimmySixDOF on Tuesday July 18, 2023 @01:58PM (#36776708)
Try the Chat Arena with ELO ratings based on end user side by side blind tests. It run out of UC Berkley by lmsys the same team that released Vicuna.

https://arena.lmsys.org/

Re:Llama 2 – Meta AI by stavros on Tuesday July 18, 2023 @03:13PM (#36777774)
That's a terrible system, it doesn't represent gaps in performance. If the first model is orders of magnitude better than the second, that system still says "99% as good" or whatever.
Re:Llama 2 – Meta AI by sebzim4500 on Tuesday July 18, 2023 @05:48PM (#36779553)
The relative difference between elo ratings is meaningless, you need to look at the absolute difference.
Re:Llama 2 – Meta AI by baby on Tuesday July 18, 2023 @08:19PM (#36780719)
This is awesome! So basically GPT-4 is the winner far ahead of alternatives. I don't see Bard in the ranking though
Re:Llama 2 – Meta AI by netsec_burn on Wednesday July 19, 2023 @08:48AM (#36785453)
It's outdated.