News for hackers. Stuff that matters.
Re:Olmo 3: Charting a path through the model flow to lead op... by mark_l_watson on Friday November 21, 2025 @08:40AM (#46004494)
This has been my question also: I spend a lot of time experimenting with local models and almost all of my use cases involve text data, but having image processing and understanding would be useful.

How much do I give up (in performance, and running on my 32G M2Pro Mac) using the VL version of a model? For MOE models, hopefully not much.

Re:Olmo 3: Charting a path through the model flow to lead op... by thot_experiment on Friday November 21, 2025 @03:54PM (#46008874)
all the qwen flavors have a VL version and it's a separate tensor stack, just a bit of vram if you want to keep it resident and vision-based queries take longer to process context but generation is still fast asf

i think the model itself is actually "smarter" because they split the thinking and instruct models so both modalities become better in their respective model

i use it almost exclusively to OCR handwritten todo lists into my todo app and i don't think it's missed yet, does a great job of toolcalling everything