Re:Qwen3.6-Plus: Towards Real World Agents
by thraxil on Thursday April 02, 2026 @04:11PM
(#47619559)
Yeah. Back when Gemma2 came out we benchmarked it and were looking at open models. For our use case though, while the tasks are pretty simple, we do need a pretty large context window and Gemini had a big lead there over the open models for quite a while. I'll probably be evaluating the current batch of open models in the near future though.
Re:Qwen3.6-Plus: Towards Real World Agents
by jimbokun on Thursday April 02, 2026 @02:20PM
(#47618172)
What’s interesting about this is that for previous technologies you could define a standard and demonstrate compliance with interfaces and behavior.
But with LLMs, how do you know switching from one to another won’t change some behavior your system was implicitly relying on?
products entirely disappearing or significantly changing will be more and more common in the llm arena as things move forward towards companies shutting down, bubbles deflating, brand priorities drastically reshifting, etc...
i think, we're at or at least close to a time to really put some thought into which pieces of your flow could be done entirely with an open/local model and be honest with ourselves on which pieces of our flow truly needs sota or closed models that may entirely disappear or change. in the long run, putting a little bit of thought into this now will save a lot of headache later.