News for hackers. Stuff that matters.
Re:Mistral NeMo by zone411 on Tuesday July 23, 2024 @05:07PM (#41050877)
The most interesting thing about it is that it’s the type of task where you'd expect LLMs to do well, yet the best models only score around 30%, while top humans get 100%. Many other benchmarks are also getting close to saturation.

There are no comments on this comment yet.