If you’re interested I did a YouTube video and short blog post about it

https://www.jerpint.io/blog/yougptube/

https://www.youtube.com/watch?v=WtMrp2hp94E

This is pretty cool. Would it be possible to just stream the audio directly into Whisper, maybe using something like vlc, at x2 play speed to get the summary faster?

Probably, the openAI api got a lot better since I made that post, though if you stream audio at 2x speed you have to expect a drop in quality since on average most clips whisper is trained on are not at 2x

My approach wasn't fancy, just asked bard (aka gemini). I was drawn to bard/gemini for this since the source video is on youtube, so figured google would better support its related service (although that was an arbitrary hunch)

https://imgur.com/a/psb64IP

Try out www.askyoutube.ai!