News for hackers. Stuff that matters.

A comment on Serving 70B-Scale LLMs Efficiently on Low-Resource Edge Devices [pdf]. Parent comment

Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D... by jsanders9 on Thursday October 03, 2024 @12:00PM (#41731939)
Ollama is close...
[ Parent | on HN ]

There are no comments on this comment yet.