ochafik
Re:Ollama's new engine for multimodal models
on Tuesday May 20, 2025 @06:02AM (#44039779)
Thanks for the kind words!
I've indeed done all that on my spare time (still under Google copyright), very happy to see this used and appreciated :-)
About to start a new job / unsure if I'll be able to contribute more, but it's been a lovely ride! (largely thanks to the other contributors and ggerganov@ himself!)
Re:Llama.cpp now supports tool calling (OpenAI-compatible)
on Saturday February 01, 2025 @08:28AM (#42898130)
Supports 8+ models’ native formats (Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) + generic fallback for all other models.
Runs anywhere; on a Mac:
brew install llama.cpp
llama-server --jinja -fa -hf bartowski/Qwen2.5-7B-Instruct-GGUF:Q4_K_M
Still fresh / lots of bugs to discover, feedback welcome!
Re:Ollama are 'try[ing to] achieve vendor lock-in'
on Saturday February 01, 2025 @08:16AM (#42898058)
When there's a will, there's a way.
It's a bit silly but I rolled out my own(*) "no-deps" C++ Jinja template library (https://github.com/google/minja) just to add tool call support to llama.cpp (https://github.com/ggerganov/llama.cpp/pull/9639).
(*): I mean, technically my employer's :-D*
Re:OpenSCAD's Web Playground got upgraded (still Alpha)
on Monday March 27, 2023 @05:50PM (#35333206)
Now much faster and more stable thanks to the Manifold engine (https://github.com/elalish/manifold): in fact it is often faster than the last stable desktop release from https://openscad.org/.
Also much better code completion, and ships with a few examples from the various bundled libraries to get you started.
OpenSCAD's Web Playground got upgraded (still Alpha)
Re:OpenSCAD 3D rendering just got an order of magnitude faster
on Thursday February 10, 2022 @07:52AM (#30285338)
Aww thanks, happy it's helping others!