News for hackers. Stuff that matters.
Re:Introducing ChatGPT and Whisper APIs by mk_stjames on Wednesday March 01, 2023 @05:53PM (#34989472)
I've ran Whisper locally via [1] with one of the medium sized models and it was damn good at transcribing audio from a video of two people having a conversation.

I don't know exactly what the use case is where people would need to run this via API; the compute isn't huge, I used CPU only (an M1) and the memory requirements aren't much.

[1] https://github.com/ggerganov/whisper.cpp

Re:Introducing ChatGPT and Whisper APIs by graderjs on Wednesday March 01, 2023 @11:37PM (#34992068)
* * *
Re:Introducing ChatGPT and Whisper APIs by Tenoke on Thursday March 02, 2023 @12:46AM (#34992439)
The 5gb model is likely too big for 95% of people's machines and renting gpus is likely not much cheaper.

I'm using also whisper myself locally to transcribe my voice notes though.