Re:Show HN: Gemini can now natively embed video, so I built ...
by kamranjon on Tuesday March 24, 2026 @01:18PM
(#47506066)
Does anyone know of an open weights models that can embed video? Would love to experiment locally with this.
[ Parent
| on HN ]
Re:Show HN: Gemini can now natively embed video, so I built ...
by sohamrj on Tuesday March 24, 2026 @01:37PM
(#47506358)
Not aware of any that do native video-to-vector embedding the way Gemini Embedding 2 does. There are CLIP-based models (like VideoCLIP) that embed frames individually, but they don't process temporal video. you'd need to average frame embeddings which loses a lot.
Would love to see open-weight models with this capability since it would eliminate the API cost and the privacy concern of uploading footage.
Re:Show HN: Gemini can now natively embed video, so I built ...
by CamperBob2 on Wednesday March 25, 2026 @12:20AM
(#47513187)
A quick search brought up https://qwen.ai/blog?id=qwen3-vl-embedding but I have no idea if it does what Gemini is doing here.
Re:Show HN: Gemini can now natively embed video, so I built ...
by jakejmnz on Wednesday March 25, 2026 @01:45PM
(#47520744)
more or less works similarly, made a proof of concept for it: https://github.com/jakejimenez/sentinelsearch
Re:Show HN: Gemini can now natively embed video, so I built ...
by CamperBob2 on Thursday March 26, 2026 @12:31AM
(#47526656)
Very cool, thanks. Will check it out.