News for hackers. Stuff that matters.
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by jsjohnst on Thursday November 14, 2024 @10:31PM (#42143736)
Need to try this directly before passing judgement, but this can unlock a few project ideas I have if the quality lives up to the examples with this low of resource requirements.
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by throwaway314155 on Thursday November 14, 2024 @10:33PM (#42143750)
Can GitHub please acquire all these model-hub companies like fal, replicate, ollama, hf, and checks notes "nexa.ai"? That way we can get past the inevitable fragmentation and ultimate breaking of everyone's workflow w.r.t. ML-oriented dev ops?
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by croes on Thursday November 14, 2024 @10:46PM (#42143802)
You want everything under the control of Microsoft?
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by byyoung3 on Thursday November 14, 2024 @10:57PM (#42143835)
Satya is that you?
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by gessha on Friday November 15, 2024 @07:54AM (#42146474)
When faced with a diversity of implantation, why is the goto “let’s have a corporate entity acquire them all” instead of “let’s come up with a good runtime standard”. The company is going to do the same thing anyway except with the additional risk of messing up the API and throwing away the hard work of so many people.
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by zhiyuan8 on Friday November 15, 2024 @12:35AM (#42144208)
I definately wish to try this https://nexa.ai/blogs/omni-vision
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by gizajob on Friday November 15, 2024 @02:28AM (#42144648)
Its description of the art piece is so awful.
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by ImageXav on Friday November 15, 2024 @08:08AM (#42146559)
I thought the same, but the description of the cat picture is pretty spot on. I wonder if this is a dataset issue. Cat pictures are far more prevalent than abstract art on the internet so might well be overrepresented. Can Vision LLMs deal with a long tail of underrepresented objects when small? Or can they only do so at scale?
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by alanzhuly on Thursday November 21, 2024 @05:20PM (#42209288)
Hi! I am from Nexa AI. We just improved Omnivision-968M based on your feedback! Here is a preview in our Hugging Face Space: https://huggingface.co/spaces/NexaAIDev/omnivlm-dpo-demo

The updated GGUF and safetensors will be released after final alignment tweaks. Please feel free to let us know if there's any other feedback!

Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by gizajob on Sunday November 24, 2024 @05:44AM (#42227180)
Why don’t you just hand-write the descriptions and then your AI won’t have to.
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by nighthawk454 on Friday November 15, 2024 @02:31AM (#42144667)
Re:Omnivision-968M: Vision Language Model with 9x Tokens Red... by TacticalCoder on Friday November 15, 2024 @06:57AM (#42146115)
I saw a turntable at a shop recently and my inner classifier went: "Oh a DSTOM turntable, that's sweet!"

https://www.project-audio.com/en/product/the-dark-side-of-th...

I was kinda expecting the model in your picture to make the link with the album cover.