News for hackers. Stuff that matters.

A comment on Serving 70B-Scale LLMs Efficiently on Low-Resource Edge Devices [pdf]. Parent comment

Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D... by paxys on Thursday October 03, 2024 @12:19PM (#41732129)
You already can with ollama
[ Parent | on HN ]

There are no comments on this comment yet.