Re:Show HN: Running LLMs in one line of Python without Docker
by bddppq on Wednesday October 04, 2023 @05:59PM
(#37772384)
lepton is at a different layer comparing to llama.cpp, in fact for LLM model files that are of GGUF format, it's using llama.cpp (ctransformers to be precise) as the execution engine
[ Parent
| on HN ]
There are no comments on this comment yet.