News for hackers. Stuff that matters.
Re:James Somers on a Whisper-driven Future by tikkun on Tuesday February 21, 2023 @09:15AM (#34881397)
What utilities related to Whisper do you wish existed? What have you had to build yourself?

On the end user application side, I wish there was something that let me pick a podcast of my choosing, get it fully transcribed, and get an embeddings search plus answer q&a on top of that podcast or set of chosen podcasts. I've seen ones for specific podcasts, but I'd like one where I can choose the podcast. (Probably won't build it)

Also on the end user side, I wish there was an Otter alternative (still paid $30/mo, but unlimited minutes per month) that had longer transcription limits. (Started building this, not much interest from users though)

Things I've seen on the dev tool side:

Gladia (API call version of Whisper)

Whisper.cpp

Whisper webservice (https://github.com/ahmetoner/whisper-asr-webservice) - via this thread

Live microphone demo (not real time, it still does it in chunks) https://github.com/mallorbc/whisper_mic

Streamlit UI https://github.com/hayabhay/whisper-ui

Whisper playground https://github.com/saharmor/whisper-playground

Real time whisper https://github.com/shirayu/whispering

Whisper as a service https://github.com/schibsted/WAAS

Improved timestamps and speaker identification https://github.com/m-bain/whisperX

MacWhisper https://goodsnooze.gumroad.com/l/macwhisper

Crossplatform desktop Whisper that supports semi-realtime https://github.com/chidiwilliams/buzz

Re:James Somers on a Whisper-driven Future by gtirloni on Tuesday February 21, 2023 @09:54AM (#34881846)
I think AssemblyAI has tools for that.
Re:James Somers on a Whisper-driven Future by causi on Tuesday February 21, 2023 @01:10PM (#34884533)
Add sponsor-skipping into that. Give me a transcript, let me select a series of words, then audio containing that series of words gets skipped on all remaining episodes.
Re:James Somers on a Whisper-driven Future by thundergolfer on Tuesday February 21, 2023 @01:40PM (#34884960)
This demo lets you choose the podcast, and is open-source: https://modal-labs--whisper-pod-transcriber-fastapi-app.moda...

https://github.com/modal-labs/modal-examples/tree/main/06_gp...

Transcribes 1hr of audio in roughly 1min, using parallelisation across CPUs.

Re:James Somers on a Whisper-driven Future by yunwal on Wednesday February 22, 2023 @12:07PM (#34898739)
I’d like to be able to search long videos (or podcasts) for a keyword (or even better, semantic search), and be directed to all time stamps in that video that match.

Things like this sort of exist, but nothing that’s really usable.

Re:James Somers on a Whisper-driven Future by userhacker on Thursday March 02, 2023 @07:13PM (#35003954)
On the end user side Revoldiv.com lets you pick any podcast you want and transcribe it