News for hackers. Stuff that matters.
Re:Serving 70B-Scale LLMs Efficiently on Low-Resource Edge D... by lxgr on Friday October 04, 2024 @09:51AM (#41741403)
That's what I mean: ARM was initially attractive in the low-power/low-performance market, then it scaled up to higher and higher power cores (while still staying power efficient), which in turn attracted datacenter customers.

There are no comments on this comment yet.