News for hackers. Stuff that matters.
Re:How to run Qwen 3.5 locally by teaearlgraycold on Sunday March 08, 2026 @03:50AM (#47295445)
I loaded Qwen into LM Studio and then ran Oh My Pi. It automatically picked up the LM Studio API server. For some reason the 35B A3B model had issues with Oh My Pi's ability to pass a thinking parameter which caused it to crash. 27B did not have that issue for me but it's much slower.

Here's how I got the 35B model to work: https://gist.github.com/danthedaniel/c1542c65469fb1caafabe13...

The 35B model is still pretty slow on my machine but it's cool to see it working.

There are no comments on this comment yet.