News for hackers. Stuff that matters.
Re:Show HN: VideoMentions – Search YouTube based on the spok... by kumarski on Wednesday May 25, 2022 @01:26PM (#31507633)
Is this based on acoustic keyword recognition or SRT search?
Re:Show HN: VideoMentions – Search YouTube based on the spok... by kellenmace on Wednesday May 25, 2022 @09:17PM (#31513093)
I believe both, in most cases. When a video is uploaded to YouTube, YouTube runs the audio through a speech-to-text algorithm to generate the transcript for the video. And the generated text is also what's used for video captions, when they're turned on. When a search is performed via VideoMentions Search, the tool gets that auto-generated transcript and searches it to find keyword matches (along with the video's title and description). When a transcript is manually uploaded for a video, that is used instead.

Thanks for checking out my project!