News for hackers. Stuff that matters.
Re:OpenAI-powered semantic search for the All-In Podcast by transitivebs on Wednesday December 21, 2022 @07:11AM (#34079621)
My favorite podcast is the All-In Pod, but search and discovery is tough for podcasts.

So I built a semantic search index that lets you search across every episode of the pod with Google-level accuracy.

It uses OpenAI's latest ada-2 embedding model and Pinecone to index the embeddings + k-NN search. Wrapped up in a Next.js + Vercel webapp.

The project is designed to work with any YouTube channel / playlist. I'm just using All-In as a demo.

Would love to hear feedback & suggestions.

Re:OpenAI-powered semantic search for the All-In Podcast by jamesbriggs on Wednesday December 21, 2022 @10:07AM (#34081600)
Very cool, how are you doing the speech-to-text part, with Whisper?
Re:OpenAI-powered semantic search for the All-In Podcast by gbertb on Wednesday December 21, 2022 @11:11AM (#34082546)
The about page explains it. Used a "hacky" method in retrieving the YT transcripts.
Re:OpenAI-powered semantic search for the All-In Podcast by gbertb on Wednesday December 21, 2022 @11:12AM (#34082555)
Great job! Love this. What other improvements besides using whisper did you have in mind?
Re:OpenAI-powered semantic search for the All-In Podcast by transitivebs on Wednesday December 21, 2022 @01:34PM (#34084510)
Honestly I haven't thought too much about it. Just having fun building :)