Show HN: I built an open source AI video search engine to learn more about AI

Re:Show HN: I built an open source AI video search engine to... by em-bee on Wednesday December 20, 2023 @08:01AM (#38708146)

the next step would be to produce descriptions of each scene in the video and search on that.

this is already possible for photos/images, so getting this for video is just a matter of time, but i don't know how far along the technology is at this point and how much resources it will take.

[ Parent | on HN ]

Re:Show HN: I built an open source AI video search engine to... by viddi on Wednesday December 20, 2023 @08:17AM (#38708289)

There is a service that produces descriptions of each scene:

https://www.videogist.co/

But I don't know about searchability.

[ Parent | on HN ]

Re:Show HN: I built an open source AI video search engine to... by yoeven on Wednesday December 20, 2023 @09:24AM (#38708993)

You read my mind! Beyond indexing the audio of the video, taking snapshots of the video content and indexing that would be pretty interesting as well. I've seen what GPT-4 vision can do for images, I'll be looking for an open source alternative that I can build around

[ Parent | on HN ]

Re:Show HN: I built an open source AI video search engine to... by em-bee on Wednesday December 20, 2023 @08:13PM (#38715926)

for image analysis you there are these two options:

https://www.adept.ai/blog/fuyu-8b

https://github.com/THUDM/CogVLM

[ Parent | on HN ]

Re:Show HN: I built an open source AI video search engine to... by yoeven on Monday December 25, 2023 @04:27AM (#38761122)

Oh nice!! Thanks, this helps :)

[ Parent | on HN ]