Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D...
by lxgr on Friday October 04, 2024 @09:51AM
(#41741403)
That's what I mean: ARM was initially attractive in the low-power/low-performance market, then it scaled up to higher and higher power cores (while still staying power efficient), which in turn attracted datacenter customers.
[ Parent
| on HN ]
There are no comments on this comment yet.