Re:Results of "Humanity's Last Exam" benchmark published
by zamalek on Thursday January 23, 2025 @01:50PM
(#42806789)
I assume that the questions (and answers) aren't published anywhere? Else it would be "Humanity's Last Exam before the previous crawl".
[ Parent
| on HN ]
Re:Results of "Humanity's Last Exam" benchmark published
by nico1207 on Thursday January 23, 2025 @05:29PM
(#42808731)
You can just view the dataset on hugging face
Re:Results of "Humanity's Last Exam" benchmark published
by HanClinto on Friday January 24, 2025 @10:29AM
(#42814014)
The public dataset is available on HF here: https://huggingface.co/datasets/cais/hle
As the main website notes: "The dataset consists of 3,000 challenging questions across over a hundred subjects. We publicly release these questions, while maintaining a private test set of held out questions to assess model overfitting."