News for hackers. Stuff that matters.
Re:Introducing ChatGPT and Whisper APIs by banana_giraffe on Wednesday March 01, 2023 @02:07PM (#34986817)
It's also annoying since there appears to be a hard limit of 25 MiB to the request size, requiring you to split up larger files and manage the "prompt" to subsequent calls. Well, somehow, near as I can tell, how you're expected to use that value isn't documented.
Re:Introducing ChatGPT and Whisper APIs by travisjungroth on Wednesday March 01, 2023 @02:14PM (#34986887)
You split up the audio and send it over in a loop. Pass in the transcript of the last call as the prompt for the next one. See item 2 here: https://platform.openai.com/docs/guides/speech-to-text/promp...
Re:Introducing ChatGPT and Whisper APIs by banana_giraffe on Wednesday March 01, 2023 @02:25PM (#34987022)
And:

> we suggest that you avoid breaking the audio up mid-sentence as this may cause some context to be lost.

That's really easy to put in a document, much harder to do in practice. Granted, it might not matter much in the real world, not sure yet.

Still, this will require more hand holding than I'd like.

Re:Introducing ChatGPT and Whisper APIs by travisjungroth on Wednesday March 01, 2023 @02:40PM (#34987217)
I doubt it will matter if you're breaking up mid sentence if you pass in the previous as a prompt and split words. This is how Whisper does it internally.

It's not absolutely perfect, but splitting on the word boundary is one line of code with the same package in their docs: https://github.com/jiaaro/pydub/blob/master/API.markdown#sil...

25MB is also a lot. That's 30 minutes to an hour on MP3 at reasonable compression. A 2 hour movie would have three splits.

Re:Introducing ChatGPT and Whisper APIs by mike_d on Wednesday March 01, 2023 @05:56PM (#34989497)
The page includes a five line Python example of how to split audio without breaking mid-word.
Re:Introducing ChatGPT and Whisper APIs by patricksamy on Friday March 10, 2023 @06:01PM (#35102481)
If that helps, just wrote a script to split the audio and use the prompt parameter to provide context with the n-1 segment transcription: https://gist.github.com/patrick-samy/cf8470272d1ff23dff4e2b5...
Re:Introducing ChatGPT and Whisper APIs by userhacker on Wednesday March 01, 2023 @02:23PM (#34987007)
I suggest you give revoldiv.com a try, We use whisper and other models together. You can upload very large files. We use intelligent chunking so that the model doesn't lose context. We are looking to increase the limit even more in the coming weeks. It's also free to transcribe any video/audio with word level timestamps.
Re:Introducing ChatGPT and Whisper APIs by BasilPH on Wednesday March 01, 2023 @04:13PM (#34988428)
I just gave it a try, and the results are impressive! Do you also offer an API?
Re:Introducing ChatGPT and Whisper APIs by userhacker on Wednesday March 01, 2023 @05:30PM (#34989243)
contact us at [email protected] and we are offering an API on a case by case basis
Re:Introducing ChatGPT and Whisper APIs by graderjs on Wednesday March 01, 2023 @11:39PM (#34992077)
* * *