News for hackers. Stuff that matters.
Re:AMD Open-Source 1B OLMo Language Models by Havoc on Saturday November 02, 2024 @10:19AM (#42026540)
It’s less size of model and more mem throughout and npu tops that’s the limiting factor for this class of device

Which means you can do larger but it’ll become ever slower

There are no comments on this comment yet.