News for hackers. Stuff that matters.

A comment on How Is LLaMa.cpp Possible?. Parent comment

Re:How Is LLaMa.cpp Possible? by eurekin on Thursday August 17, 2023 @01:24PM (#37165162)
Just checked on a m1 w 32GB ram. 7b and 13b work as a charm. 70b doesn't fit, even the 2 bit version
[ Parent | on HN ]

There are no comments on this comment yet.