News for hackers. Stuff that matters.
Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by modeless on Wednesday December 13, 2023 @03:12PM (#38633531)
You can definitely do this with the open source version. Many transcription implementations use it to maintain context between the max-30-second chunks Whisper natively supports.
Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by swores on Wednesday December 13, 2023 @04:08PM (#38634152)
I'll try to understand some of how stuff like faster-whisper works when I've got time over the weekend, but I fear it may be too complex for me...

I was rather hoping for a guide of just how to either adapt classic whisper usage or adapt one of the optimised ones like faster-whisper (which I've just set up in a docker container but that's used up all the time I've got for playing around right now) to take a text prompt with the audio file.