Very cool, curious if you plan to add a summarize feature along with this? I know there are other apps that do that already, but would be good to follow along inside the same single app.

I would like first to generate chapters (perhaps using a T5 model). Summarization is also possible.

Most YouTube transcripts lack punctuations. So this app adds them back using a deep learning model based on DistilBert converted to ONNX for inference in your browser.

I saw it was running within the browser. That's beyond awesome.

Yes I’m also surprised how many tasks can be done using ONNX in the browser. The model I found and converted for browser use is here https://huggingface.co/ldenoue/distilbert-base-re-punctuate

Wow this is one of the most useful foundational AI things I have seen in a while. Is this open source? I have a really core use-case I think.

It’s not open source but I did publish the ONNX converted model to HuggingFace here https://huggingface.co/ldenoue/distilbert-base-re-punctuate

It’s amazing what Xenova Transformers JS can do to run ONNX models. And WebGPU is coming soon!

I tried it and it worked great, congratulations! Looking forward to having chapters or at least separate paragraphs, I think you're doing right by giving that priority, as you mentioned in another comment.

Chapters should come first then?

Is it possible to get the chapters directly from YouTube? As many videos already have them defined by the creator.

This is great! Do you rely on YouTube captions or do some sort of ASR?

It uses the existing YouTube transcript and adds punctuations using a deep net that runs in your browser