News for hackers. Stuff that matters.
Re:OpenAI Audio Models by progbits on Thursday March 20, 2025 @02:31PM (#43427108)
> Two speech-to-text models—outperforming Whisper

On what metric? Also Whisper is no longer state of the art in accuracy, how does it compare to the others in this benchmark?

https://artificialanalysis.ai/speech-to-text

Re:OpenAI Audio Models by jeffharris on Thursday March 20, 2025 @03:04PM (#43427550)
We've been using the FLUERS eval and you can see comparisons to other models on the market in the post https://openai.com/index/introducing-our-next-generation-aud...

Curious if there's a benchmark you trust most?

Re:OpenAI Audio Models by lern_too_spel on Thursday March 20, 2025 @03:51PM (#43428051)
FLUERS and GP's Common Voice dataset focus on read speech. I've observed models that perform well on these datasets be completely useless on other distributions, like whispered speech or shouted speech or conversational speech between humans who aren't talking to a computer.