News for hackers. Stuff that matters.

A comment on Gemma.cpp: lightweight, standalone C++ inference engine for Gemma models.

Re:Gemma.cpp: lightweight, standalone C++ inference engine f... by Wissan on Friday February 23, 2024 @12:00PM (#39483134)
Hello
[ Parent | on HN ]
Re:Gemma.cpp: lightweight, standalone C++ inference engine f... by sintax on Friday February 23, 2024 @01:53PM (#39484672)
Demo when model quantized to q0_K?
[ Parent | on HN ]