Re:Gemini Flash
by sp332 on Tuesday May 14, 2024 @10:45PM
(#40362561)
No, but you can just cache the state after processing the prompt. https://github.com/ggerganov/llama.cpp/tree/master/examples/...
[ Parent
| on HN ]
There are no comments on this comment yet.