News for hackers. Stuff that matters.
Re:Answer any question about your photo albums with OmniQuery by nareshshah139 on Friday October 11, 2024 @12:08AM (#41806020)
Nah, you can do all of this with a simple phi3.5 instruct + SAM 2, both of which fit into an Nvidia Jetson Orin 64 GB chip.

We do this at scale in factories/warehouses describing everything that happens within like:

Idle time Safety Incidents Process Following across frames Breaks Misplacement of items Counting items placed/picked/assembled across frames

Re:Answer any question about your photo albums with OmniQuery by nareshshah139 on Friday October 11, 2024 @12:09AM (#41806026)
SAM2/Grounding DINO + Phi3.5 Instruct(Vision) give essentially an unlimited vocabulary
Re:Answer any question about your photo albums with OmniQuery by nareshshah139 on Friday October 11, 2024 @12:10AM (#41806031)
If you want audio transcription just add distill-whisper to the mix.
Re:Answer any question about your photo albums with OmniQuery by llm_trw on Friday October 11, 2024 @12:41AM (#41806210)
You should perhaps use that system to reread my post. Maybe it can explain it to you top.