News for hackers. Stuff that matters.

A comment on How Is LLaMa.cpp Possible?. Parent comment

Re:How Is LLaMa.cpp Possible? by Joeri on Wednesday August 16, 2023 @11:00AM (#37148134)
Inference speed. Sometimes 7B is good enough for the task at hand, and using 13B just makes you wait longer.
[ Parent | on HN ]

There are no comments on this comment yet.