News for hackers. Stuff that matters.
Re:Gemma.cpp: lightweight, standalone C++ inference engine f... by moffkalast on Friday February 23, 2024 @04:46PM (#39486538)
Of the ones I commonly use, I've only seen it read by text-generation-webui, in the GGML days it had a long hardcoded list of known models and which templates they use so they could be auto-selected (which was often wrong), but now it just grabs it from any model directly and sets it when it's loaded.

There are no comments on this comment yet.