Llama.cpp now supports tool calling (OpenAI-compatible) Posted by ochafik on Saturday February 01, 2025 @08:28AM from the github.com dept. https://github.com/ggerganov/llama.cpp/pull/9639 ( 1 comment | 2 points | on HN )
Runs anywhere; on a Mac:
Still fresh / lots of bugs to discover, feedback welcome!