News for hackers. Stuff that matters.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by sReinwald on Thursday March 06, 2025 @03:17AM (#43277757)
You can also set

    OLLAMA_CONTEXT_LENGTH=<tokens>
as an environment variable to change ollama's default context length.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by Tepix on Thursday March 06, 2025 @08:27AM (#43279944)
I think that will not work if you use the OpenAI compatible API endpoint.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by svachalek on Thursday March 06, 2025 @10:14AM (#43281153)
I tried this with ollama run, and it had no effect at all.
Re:QwQ-32B: Embracing the Power of Reinforcement Learning by underlines on Thursday March 06, 2025 @05:04PM (#43285513)
that env parameter is brand new, did you update ollama?