News for hackers. Stuff that matters.

A comment on Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style LLM on a MacBook. Parent comment

Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by dvt on Thursday March 16, 2023 @08:51PM (#35191230)
How well does it work on DRAM? I thought everyone running heavier models are doing it on GPUs.
[ Parent | on HN ]
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by satvikpendem on Thursday March 16, 2023 @09:12PM (#35191413)
Alpaca works entirely off CPU so the models should work fine. I'll try tomorrow and report back.
[ Parent | on HN ]