Re:DeepSeek gives Europe's tech firms a chance to catch up
by avereveard on Monday February 03, 2025 @07:02AM
(#42917343)
Also Ollama is traditionally very sloppy with the chat templates they use, which does impact model performances.
[ Parent
| on HN ]
Re:DeepSeek gives Europe's tech firms a chance to catch up
by vergessenmir on Monday February 03, 2025 @07:43AM
(#42917627)
I feel this particularly when I use gguf support.
How do you get accurate information on the template structure?
Re:DeepSeek gives Europe's tech firms a chance to catch up
by diggan on Monday February 03, 2025 @08:19AM
(#42917916)
> Ollama is traditionally very sloppy with the chat templates they use
Not that I don't believe you (I do, and I think I've seen them correct this before too), but you happen to have specific examples when this happened?
Re:DeepSeek gives Europe's tech firms a chance to catch up
by avereveard on Monday February 03, 2025 @09:42AM
(#42918641)
https://github.com/ollama/ollama/issues/1977
More recently deepseek 2 had a space after the assistant turn, causing issues with output quality and language https://www.reddit.com/r/LocalLLaMA/comments/1dko6rp/if_your...