Re:Gemma.cpp: lightweight, standalone C++ inference engine f...
by moffkalast on Friday February 23, 2024 @04:46PM
(#39486538)
Of the ones I commonly use, I've only seen it read by text-generation-webui, in the GGML days it had a long hardcoded list of known models and which templates they use so they could be auto-selected (which was often wrong), but now it just grabs it from any model directly and sets it when it's loaded.
That sounds very convenient. What software makes use of the built-in prompt template?