Re:Gemma.cpp: lightweight, standalone C++ inference engine f...
by moffkalast on Friday February 23, 2024 @04:46PM
(#39486538)
Of the ones I commonly use, I've only seen it read by text-generation-webui, in the GGML days it had a long hardcoded list of known models and which templates they use so they could be auto-selected (which was often wrong), but now it just grabs it from any model directly and sets it when it's loaded.
[ Parent
| on HN ]
There are no comments on this comment yet.