My benchmark for large language models

Posted by cheviethai123 on Tuesday February 20, 2024 @11:38PM
from the nicholas.carlini.com dept.

https://nicholas.carlini.com/writing/2024/my-benchmark-for-large-language-models.html

( 2 comments | 2 points | on HN )

Re:My benchmark for large language models by cheviethai123 on Tuesday February 20, 2024 @11:38PM (#39450217)

Consider how low the score of Gemini here compared to the other LLM test. And I'm impressed by the evaluation method's ability to assess performance without relying on tailored prompts.

[ Parent | on HN ]

Re:My benchmark for large language models by hoamatcuoi on Tuesday February 20, 2024 @11:45PM (#39450244)

But the benchmark only scoring Gemini-Pro 1, I'm curious how the Gemini Ultra performance here but guessed we couldn't know yet.

[ Parent | on HN ]