News for hackers. Stuff that matters.
Re:GPT-5: Key characteristics, pricing and system card by empiko on Thursday August 07, 2025 @01:26PM (#44827455)
Despite the fact that their models are used in hiring, business, education, etc this multibillion company uses one benchmark with very artificial questions (BBQ) to evaluate how fair their model is. I am a little bit disappointed.
Re:GPT-5: Key characteristics, pricing and system card by xmorse on Friday August 08, 2025 @05:46AM (#44835209)
It's because these industries don't create their own benchmarks. The only ones creating evals are the AI company themselves or open source software engineers