Re:Gemma.cpp: lightweight, standalone C++ inference engine f...
by null_point on Friday February 23, 2024 @03:43PM
(#39485855)
I found the magic! https://github.com/search?q=repo%3Aggerganov%2Fggml%20magic&...
Re:Gemma.cpp: lightweight, standalone C++ inference engine f...
by null_point on Saturday February 24, 2024 @09:45AM
(#39491805)
Hey, c'mon now. Just being playful about the "magic" string used in GGUF files to detect that it is in-fact a GGUF file.
Also, there's a lot of magic going on behind the scenes with configs stored in gguf/huggingface format models, and the libraries that use them. There are different tokenizers, but they mostly follow the same standards.