News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by rbnsl on Monday April 01, 2024 @02:15PM (#39897250)
Definitely wild we’re in the timeline you can run a 1.1 bn param model on a raspberry pi, but its still tough to justify because the 1.1 is kinda useless compared to the beefier models. Sick for home builds/hobbyists though I might wanna get one of the new Pis just to try this out

There are no comments on this comment yet.