How to run Qwen 3.5 locally

Re:How to run Qwen 3.5 locally by jadbox on Sunday March 08, 2026 @09:09AM (#47297024)

Did you figure out how to fix Thinking mode? I had to turn it off completely as it went on forever, and I tried to fix it with different parameters without success.

[ Parent | on HN ]

Re:How to run Qwen 3.5 locally by sammyteee on Sunday March 08, 2026 @12:02PM (#47298381)

Thinking has definitely become a bit more convuluted in this model - I gave the prompt of "hey" and it thought for about two minutes straight before giving a bog-standard "hello, how can i help" reply etc

[ Parent | on HN ]

Re:How to run Qwen 3.5 locally by andrekandre on Sunday March 08, 2026 @08:26PM (#47303255)

supposedly you can turn it off by passing `\no_think` or `/no_think` into the prompt but it never worked for me

what did work was passing / adding this json to the request body:

   { "chat_template_kwargs": {"enable_thinking": false}}

[0] https://github.com/QwenLM/Qwen3/discussions/1300

[ Parent | on HN ]

Re:How to run Qwen 3.5 locally by agile-gift0262 on Monday March 09, 2026 @03:55AM (#47306001)

did you try with the recommended settings? the ones for thinking mode, general tasks, really worked for me. Especially the repetition_penalty. At first it wasn't working very well, and it was because I was using OpenWebUI's "Repeat Penalty" field, and that didn't work. I needed to set a custom field with the exact name

[ Parent | on HN ]