News for hackers. Stuff that matters.
Re:Ask HN: Will it be a viable business model to offer llama... by version_five on Wednesday September 27, 2023 @12:06PM (#37676771)
Short answer, possibly, especially if it was say part of a rag system or some other architecture like that. There is room for more. Nothing particularly special about llama.cpp as the llm back end though. It's optimized for running on lower-end hardware which matters less if you're serving models as a service. But it has many strengths.

Llama.cpp / ggml is the open core of ggml.ai founded by GG and funded by the guy from github, so they have some monetization plan for it.

There are no comments on this comment yet.