News for hackers. Stuff that matters.
Re:Bagel: The Open-Source Unified Multimodal Model by charcircuit on Monday May 26, 2025 @04:22AM (#44095213)
The demo shows pretty weak performance compared to other small models. It misunderstood my question due to picking an uncommon way to interpret it. After clarifying what I wanted it lost all context I had provided in the previous message. My benchmark query intentionally ambiguous and I use it to see how models handle ambiguity, handle information which can be outdated, and handle avoiding hallucination. Usually weak models will just hallucinate an answer, but this model was the first who want able to understand the question.

There are no comments on this comment yet.