That's a terrible system, it doesn't represent gaps in performance. If the first model is orders of magnitude better than the second, that system still says "99% as good" or whatever.
Re:Llama 2 – Meta AI
by sebzim4500 on Tuesday July 18, 2023 @05:48PM
(#36779553)
The relative difference between elo ratings is meaningless, you need to look at the absolute difference.
This is awesome! So basically GPT-4 is the winner far ahead of alternatives. I don't see Bard in the ranking though
Re:Llama 2 – Meta AI
by netsec_burn on Wednesday July 19, 2023 @08:48AM
(#36785453)
It's outdated.
https://arena.lmsys.org/