News for hackers. Stuff that matters.

A comment on Show HN: Search inside YouTube videos using natural language queries. Parent comment

Re:Show HN: Search inside YouTube videos using natural langu... by canada_dry on Friday February 12, 2021 @08:54PM (#26120766)
Great demo.

Wondering whether it would be more efficient if extracting frames where the content has changed (e.g. over a threshold and/or all I-frames)?

Also, could this be used to identify event type in videos? I'd love to run my 25 years of home videos through this an have it annotate: "Christmas, birthday, park, camping...".

[ Parent | on HN ]
Re:Show HN: Search inside YouTube videos using natural langu... by vladoh on Saturday February 13, 2021 @03:34AM (#26122264)
Yes, this is definitely possible. You can maybe try computing some kind of image distance between frames or some keyframe extraction.

Once you compute the features, the search is very efficient! I tried it for searching in the 2M photos dataset from Unsplash and it takes like 2-3 seconds: https://github.com/haltakov/natural-language-image-search

I plan to run my personal photos through it :)

[ Parent | on HN ]