Smollm3: Smol, multilingual, long-context reasoner LLM

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by kosolam on Wednesday July 09, 2025 @07:33AM (#44508731)

Could you please enlighten me regarding all these engines, I’m using lamacpp and ollama. Should I also try mlx, onnx, vllm, etc. I’m not quite sure whats the difference between all these. I’m running on CPU and sometimes GPU

[ Parent | on HN ]

Re:Smollm3: Smol, multilingual, long-context reasoner LLM by pzo on Wednesday July 09, 2025 @11:00AM (#44510843)

Ollama is a wrapper around llama.cpp thei using ggml format. Onnx is different ml model format and onnxruntime developer by microsoft. Mlx is ml framework from Apple. If you want the fastest speed on MacOS most likely stick with mlx

[ Parent | on HN ]