You have a number of other European providers of open-weight LLMs, such as Bielik and Aleph Alpha. They are not trying to compete at the frontier, but they sometimes develop original architectures. I am also a big fan of PleIAs' research in this regard, have a look at their Baguettotron