Why we write our own C and C++ inference engines

Re:Why we write our own C and C++ inference engines by bastawhiz on Monday August 03, 2026 @05:01PM (#49161384)

Then the article should have talked about those things and not pointed at nonsense.

[ Parent | on HN ]

Re:Why we write our own C and C++ inference engines by ferfumarma on Wednesday August 05, 2026 @04:19AM (#49179998)

It's literally the third paragraph:

> Deploying a Python inference stack means resolving a dependency tree at install time, on the target machine, against whatever CUDA and glibc that machine has. Deploying a ggml port means copying a shared library and a GGUF file.

[ Parent | on HN ]