Re:Ollama has a native front end chatbot now
by _boffin_ on Wednesday July 30, 2025 @11:43PM
(#44742123)
You know that if you go to hugging face and find a gguf page, you can click on Deploy and select ollama. It comes with “run” but whatever—just change to pull. Has a jacked name, but works.
Also, if you search on ollama’s models, you’ll see user ones that you can download too
Re:Ollama has a native front end chatbot now
by mchiang on Thursday July 31, 2025 @12:31AM
(#44742317)
We work closely with majority of research labs / model creates directly. Most of the times we will support models on release day. There are sometimes where the release window for major models are fairly close - and we just have to elect to support models where we believe will better support a majority of users.
Nothing out of spite, and purely limited by the amount of effort required to support these models.
We are hopeful too -- where users can technically add models to Ollama directly. Although there is definitely some learning curve.
Re:Ollama has a native front end chatbot now
by kinduff on Thursday July 31, 2025 @02:08AM
(#44742790)
Would love to add models direclty. And don't worry, we will figure it out!
Re:Ollama has a native front end chatbot now
by coder543 on Thursday July 31, 2025 @12:31AM
(#44742322)
GLM 4.5 has a new/modified architecture. From what I understand, MLX was really one of the only frameworks that had support for it as of yesterday. LM Studio supports MLX as one backend. Everyone else was/is still developing support for it.
Ollama has the new 235B and 30B Qwen3 models from this week, so it’s not as if they have done nothing for a month.
Re:Ollama has a native front end chatbot now
by pmarreck on Thursday July 31, 2025 @02:57PM
(#44748892)
ah, that explains why all the GLM quants are MLX models
just so you know, you can grab any gguf from huggingface and specify the quant like this:
ollama pull hf.co/bartowski/nvidia_OpenCodeReasoning-Nemotron-7B-GGUF:IQ4_XS
Re:Ollama has a native front end chatbot now
by WithinReason on Thursday July 31, 2025 @10:04AM
(#44745783)
qwen3 was updated less than a day ago:
https://ollama.com/library/qwen3
thank you guys for all your work on it, regardless