befelix

FP8 weights are actually the default and what we trained for: http://huggingface.co/Aleph-Alpha/Kolibri-1

We have a separate repo for BF16: Kolibri-1-BF16. Will still be tough to put it on a Mac though :(

Disclaimer: I'm part of the team that trained Kolirbi

Somewhat hilariously, our model is actually surprisingly bad at telling jokes in German. Guess that's not required to solve tasks in training environments.

Disclaimer: I am part of the team that trained Kolibri

Disclaimer: I am part of the team that trained Kolibri, opinions are mine.

You're right that especially big models benefit from training on copyrighted material in terms of world knowledge (especially from books). However, in the small model space imho agentic capabilities where the model looks up knowledge on the fly are much more important. That's what we focused on quite a bit during training. Personally, I also don't think stealing stuff is okay.

Disclaimer: I am part of the team that trained Kolibri, opinions are mine.

Qwen models have solid performance on benchmarks and we're transparent about this in the report. We're just happy to share a European alternative in the small model space, where I don't think we can afford to be fully dependent on China. We also put a lot of effort into German language quality things that don't show up in evals at all (style, Grammar, German reasoning, etc).

Sovereignty is imho mostly about choice and control over your data. Cohere is no different on that front and personally I'm quite excited about what we will build together post-merger.