News for hackers. Stuff that matters.
Re:DeepSeek gives Europe's tech firms a chance to catch up by avereveard on Monday February 03, 2025 @07:02AM (#42917343)
Also Ollama is traditionally very sloppy with the chat templates they use, which does impact model performances.
Re:DeepSeek gives Europe's tech firms a chance to catch up by vergessenmir on Monday February 03, 2025 @07:43AM (#42917627)
I feel this particularly when I use gguf support.

How do you get accurate information on the template structure?

Re:DeepSeek gives Europe's tech firms a chance to catch up by diggan on Monday February 03, 2025 @08:19AM (#42917916)
> Ollama is traditionally very sloppy with the chat templates they use

Not that I don't believe you (I do, and I think I've seen them correct this before too), but you happen to have specific examples when this happened?

Re:DeepSeek gives Europe's tech firms a chance to catch up by avereveard on Monday February 03, 2025 @09:42AM (#42918641)
https://github.com/ollama/ollama/issues/1977

More recently deepseek 2 had a space after the assistant turn, causing issues with output quality and language https://www.reddit.com/r/LocalLLaMA/comments/1dko6rp/if_your...