News for hackers. Stuff that matters.
Re:Show HN: Running LLMs in one line of Python without Docker by bddppq on Wednesday October 04, 2023 @05:59PM (#37772384)
lepton is at a different layer comparing to llama.cpp, in fact for LLM model files that are of GGUF format, it's using llama.cpp (ctransformers to be precise) as the execution engine

There are no comments on this comment yet.