News for hackers. Stuff that matters.

A comment on Show HN: We made our own inference engine for Apple Silicon. Parent comment

Re:Show HN: We made our own inference engine for Apple Silicon by khurs on Tuesday July 15, 2025 @06:28PM (#44576529)
Ollama is the leader isn't it?

Brew stats (downloads last 30 days)

Ollama - 28,232 Lama.cpp - 7,826

[ Parent | on HN ]
Re:Show HN: We made our own inference engine for Apple Silicon by DiabloD3 on Wednesday July 16, 2025 @12:56AM (#44578802)
Ollama isn't an inference engine, its a GUI slapped onto a perpetually out-of-date vendored copy of Llama.cpp underneath.

So, if you're trying to actually count LLama.cpp downloads, you'd combine those two. Also, I imagine most users on OSX aren't using Homebrew, they're getting it directly from the GH releases, so you'd also have to count those.

[ Parent | on HN ]
Re:Show HN: We made our own inference engine for Apple Silicon by imtringued on Wednesday July 16, 2025 @02:00AM (#44579160)
Actually, ollama has stopped using llama.cpp and is using ggml directly nowadays.
[ Parent | on HN ]