Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D...
by kridsdale3 on Thursday October 03, 2024 @01:09PM
(#41732651)
That looked like an analogy. Back in the days of a mechanical arm moving magnetic fields around in our PCs, you could have the illusion of infinite RAM as long as you're ok with microsecond operations now taking two million times longer. This is akin.
[ Parent
| on HN ]
There are no comments on this comment yet.