News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by stavros on Tuesday July 18, 2023 @03:13PM (#36777774)
That's a terrible system, it doesn't represent gaps in performance. If the first model is orders of magnitude better than the second, that system still says "99% as good" or whatever.
Re:Llama 2 – Meta AI by sebzim4500 on Tuesday July 18, 2023 @05:48PM (#36779553)
The relative difference between elo ratings is meaningless, you need to look at the absolute difference.