News for hackers. Stuff that matters.
Re:Show HN: We made our own inference engine for Apple Silicon by DiabloD3 on Wednesday July 16, 2025 @12:56AM (#44578802)
Ollama isn't an inference engine, its a GUI slapped onto a perpetually out-of-date vendored copy of Llama.cpp underneath.

So, if you're trying to actually count LLama.cpp downloads, you'd combine those two. Also, I imagine most users on OSX aren't using Homebrew, they're getting it directly from the GH releases, so you'd also have to count those.

Re:Show HN: We made our own inference engine for Apple Silicon by imtringued on Wednesday July 16, 2025 @02:00AM (#44579160)
Actually, ollama has stopped using llama.cpp and is using ggml directly nowadays.