Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by epups on Tuesday January 09, 2024 @03:57AM
(#38923856)
I find it baffling that anyone would take these benchmarks seriously. The methodology is not transparent, and some of the tests completely unfair, like those in German or about specific niche German topics. The author readily acknowledges that these tests are his personal interests, which is totally fair. But that it would rise to the top of that subreddit and now HN as a general measure of quality of any kind is indicative of the lack of reliable benchmarks out there.
[ Parent
| on HN ]
Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by bugglebeetle on Tuesday January 09, 2024 @12:34PM
(#38929011)
It’s all just people jockeying for influence and hype, like crypto before it.