DeepSeek: X2 Speed for WASM with SIMD

Re:DeepSeek: X2 Speed for WASM with SIMD by realo on Tuesday January 28, 2025 @12:05PM (#42854761)

Hello...

Is it possible to use aider with a local model running in LMStudio (or ollama)?

From a quick glance i did not see an obvious way to do that...

Hopefully i am totally wrong!

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by simonw on Tuesday January 28, 2025 @12:07PM (#42854805)

https://aider.chat/docs/llms/ollama.html

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by anotherpaulg on Tuesday January 28, 2025 @12:07PM (#42854806)

Thanks for your interest in aider.

Yes, absolutely you can work with local models. Here are the docs for working with lmstudio and ollama:

https://aider.chat/docs/llms/lm-studio.html

https://aider.chat/docs/llms/ollama.html

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by leetharris on Tuesday January 28, 2025 @12:13PM (#42854909)

Yes absolutely

In the left bar there's a "connecting to LLMs" section

Check out ollama as an example

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by m3kw9 on Tuesday January 28, 2025 @12:11PM (#42854880)

Yes and is easy

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by fragmede on Tuesday January 28, 2025 @02:13PM (#42856618)

yeah:

    aider --model ollama_chat/deepseek-r1:32b

(or whatever)

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by sureglymop on Tuesday January 28, 2025 @04:01PM (#42857939)

This didn't work well for me, no changes are ever made but maybe it's because I'm just using the 14B model.

[ Parent | on HN ]

Re:DeepSeek: X2 Speed for WASM with SIMD by manmal on Tuesday January 28, 2025 @05:07PM (#42858700)

In case you are on a 32+GB Mac, you could try deepseek-r1-distill-qwen-32b-mlx in LM Studio. It’s just barely usable speed-wise, but gives useful results most of the time.

[ Parent | on HN ]