News for hackers. Stuff that matters.

ochafik

Re:Ollama's new engine for multimodal models on Tuesday May 20, 2025 @06:02AM (#44039779)
Thanks for the kind words!

I've indeed done all that on my spare time (still under Google copyright), very happy to see this used and appreciated :-)

About to start a new job / unsure if I'll be able to contribute more, but it's been a lovely ride! (largely thanks to the other contributors and ggerganov@ himself!)

Re:Llama.cpp now supports tool calling (OpenAI-compatible) on Saturday February 01, 2025 @08:28AM (#42898130)
Supports 8+ models’ native formats (Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) + generic fallback for all other models.

Runs anywhere; on a Mac:

  brew install llama.cpp
  llama-server --jinja -fa -hf bartowski/Qwen2.5-7B-Instruct-GGUF:Q4_K_M
Still fresh / lots of bugs to discover, feedback welcome!
Re:Ollama are 'try[ing to] achieve vendor lock-in' on Saturday February 01, 2025 @08:16AM (#42898058)
When there's a will, there's a way.

It's a bit silly but I rolled out my own(*) "no-deps" C++ Jinja template library (https://github.com/google/minja) just to add tool call support to llama.cpp (https://github.com/ggerganov/llama.cpp/pull/9639).

(*): I mean, technically my employer's :-D*

Re:OpenSCAD's Web Playground got upgraded (still Alpha) on Monday March 27, 2023 @05:50PM (#35333206)
Now much faster and more stable thanks to the Manifold engine (https://github.com/elalish/manifold): in fact it is often faster than the last stable desktop release from https://openscad.org/.

Also much better code completion, and ships with a few examples from the various bundled libraries to get you started.

Re:OpenSCAD 3D rendering just got an order of magnitude faster on Thursday February 10, 2022 @07:52AM (#30285338)
Aww thanks, happy it's helping others!