News for hackers. Stuff that matters.

A comment on OpenAI Audio Models. Parent comment

Re:OpenAI Audio Models by simonw on Thursday March 20, 2025 @03:50PM (#43428044)
The feature I want is speaker differentiation - I want to feed in an audio file and get back a transcript with "Speaker 1: ..., Speaker 2: ..." indications.

That plus timestamps would be incredible.

The Google Gemini 2.0 models are showing some promise with this, I can't speak to their reliability just yet though.

[ Parent | on HN ]
Re:OpenAI Audio Models by runeb on Thursday March 20, 2025 @04:10PM (#43428309)
I had good results with pyannote and the following model for that use case in the past https://huggingface.co/pyannote/speaker-diarization-3.1
[ Parent | on HN ]
Re:OpenAI Audio Models by infecto on Thursday March 20, 2025 @04:24PM (#43428473)
I thought Deepgram already did speaker diarization (which is differentiation) pretty well. That and it can include timestamps plus other metadata.
[ Parent | on HN ]
Re:OpenAI Audio Models by thot_experiment on Thursday March 20, 2025 @05:39PM (#43429293)
WhisperX does all of this, I use it all the time to transcribe meeting notes. Both speaker differentiation and individual word timestamps.
[ Parent | on HN ]