News for hackers. Stuff that matters.

A comment on Apertus 70B: Truly Open - Swiss LLM by ETH, EPFL and CSCS.

Re:Apertus 70B: Truly Open - Swiss LLM by ETH, EPFL and CSCS by coalteddy on Friday September 05, 2025 @09:12PM (#45145630)
Very cool. Love this. Was the training more heavily weighted towards swiss languages and how does the model perform on swiss languages compared to others?

Are there any plans for further models after this one?

[ Parent | on HN ]
Re:Apertus 70B: Truly Open - Swiss LLM by ETH, EPFL and CSCS by lllllm on Saturday September 06, 2025 @06:31AM (#45148120)
The pretraining (so 99% of training) is fully global, in over 1000 languages without special weighting. The posttraining (See section 4 of the paper) had also as many languages as we could get, and did upweight some languages. The posttraining can easily be customized to any other target languages
[ Parent | on HN ]