News for hackers. Stuff that matters.

A comment on Serving 70B-Scale LLMs Efficiently on Low-Resource Edge Devices [pdf]. Parent comment

Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D... by mysterhawk on Thursday October 03, 2024 @12:06PM (#41731985)
https://justine.lol/matmul/

https://www.youtube.com/watch?v=-mRi-B3t6fA

Checkout these articles

[ Parent | on HN ]

There are no comments on this comment yet.