News for hackers. Stuff that matters.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by rafram on Monday May 25, 2026 @10:54PM (#48274450)
> Marius Husnes, the Head of IT Platform at the library (Nasjonlbiblioteket) discussed the project at Huawei’s ID Forum 2026 in Paris, saying that no commercial LLM provider was developing a local (Norwegian) language LLM. He asserted that any country with its own language that did not have a sovereign LLM trained in that language was at a disadvantage as a globally trained, English-speaking LLM would not know about that country’s history, news and culture that was described in the local language.

I am not overly confident that Marius Husnes knows what he’s talking about here.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by chvid on Tuesday May 26, 2026 @12:12AM (#48274902)
When I am chatting with ChatGPT - it is fairly obvious that it is American - its native language, its style, its attitude is American - even if we chat in Danish.

Just as we cannot rely on Netflix and HBO to produce Scandinavian TV-shows even though they might do at the moment, we need to make our own stuff in this area too.

And over time, the technology to do this will become cheap and readily available for us to do so.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by anal_reactor on Tuesday May 26, 2026 @02:37AM (#48275894)
> And over time, the technology to do this will become cheap and readily available for us to do so.

But then the English models will be even better and you'll be back to square one. My guess is that things are going to become more and more American. If you assume that "culture" is a resource like "microchips", then from economic point of view it makes sense to have one country specialize in producing it, and the rest just consume. This is why when you turn on the main radio station of a random country, you're so likely to hit American music.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by ikr678 on Tuesday May 26, 2026 @02:54AM (#48276043)
'Only one country should export culture, for economic efficiency' is the kind of take that the Norweigians (and everyone else) would like to protect themselves from.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by pjc50 on Tuesday May 26, 2026 @06:09AM (#48277540)
> then from economic point of view it makes sense to have one country specialize in producing it, and the rest just consume

And, for exactly the same reasons as Europeans need to have sovereign compute to protect against economic imperialism, it is also essential to maintain local culture in order to avoid the great replacement of everything with Americanisms.

Yes, it requires pushing against the economics. But you have to do that if you believe that culture has any value per se at all.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by wasmitnetzen on Tuesday May 26, 2026 @08:27AM (#48278834)
> If you assume that "culture" is a resource like "microchips"

I do not. American culture exports American values, which are not universal. Simplest examples being the attitudes towards violence and nudity, which are very different in Europe, and vary within Europe as well.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by anal_reactor on Tuesday May 26, 2026 @09:47AM (#48279849)
Which is already changing thanks to the American influence.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by fastasucan on Wednesday May 27, 2026 @04:17PM (#48299990)
>makes sense to have one country specialize in producing it, and the rest just consume

Oh ok then, just finnish culture for you then.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by amunozo on Tuesday May 26, 2026 @09:17AM (#48279437)
I chat to it in English instead of my native Spanish not only because of performance, but because I cannot stand the unnatural style it has in Spanish.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by spiderfarmer on Monday May 25, 2026 @11:10PM (#48274538)
It sounds plausible enough to get subsidies.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by idiotsecant on Monday May 25, 2026 @11:36PM (#48274679)
You're making the mistake of thinking whether he knows what he is talking about matters. He is brewing a potion. It's ingredients are a trendy term, a vaguely spooky threat and a clear, overly simplistic solution that of course he will graciously assume control of, for the good of the motherland.

This potion is potent and you'd think it would stop working from frequent misuse but you'd be wrong!

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by vintermann on Tuesday May 26, 2026 @12:11AM (#48274893)
He won't have control over it.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by fnordpiglet on Tuesday May 26, 2026 @12:30AM (#48275003)
He’s right though, although it’s not entirely about the training corpus. It’s about the tokenizer that tokenizes substrings more efficiently based on a necessary bias towards a target language. English oriented LLMs are more powerful for English than other languages because the token space is more parsimonious in English language. Try any online Anthropic tokenizer that calls their api with common English words (typically one or fewer tokens) and Norwegian words - you’ll often see 2-4 tokens instead sometimes more. Some languages like Thai are at a huge disadvantage. Likewise often the corpus selection also is heavily skewed towards the target language simply because more energy is applied to sourcing written works in that language. There will also be semantic biases in the vector space due to cross influence between semantically similar embeddings between languages that create a different than cultural baseline. Finally fine tuning greatly impacts cultural expression in the LLM. None of these are trivial effects.

There are a lot of efforts to create LLMs for dying languages and others that use cross cultural models to boost, but if your language is well literate, there’s a good reason to build a heritage LLM specific to your language and culture. Expecting OpenAI or Anthropic to prioritize your language over their target audience when a tradeoff is to be made is absurd.

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by YetAnotherNick on Tuesday May 26, 2026 @02:13AM (#48275679)
Did you even try to verify your claims. I tested it on few translations on wikipedia articles using [1] and it takes 15-20% more tokens for Norwegian.

English performs the best because there is more data in English and high quality sources are either only in English or there is a good translation in English.

[1]: https://platform.openai.com/tokenizer

Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by tecleandor on Tuesday May 26, 2026 @07:16AM (#48278133)
Tests I've done with NO and FI texts, for the same number of characters, with the GPT5 tokenizer I get around 2x the tokens than EN. With the older tokenizers it's more like 2x or even 3x.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by numpad0 on Tuesday May 26, 2026 @07:44AM (#48278385)
Tokenizer efficiency varying by languages, by as much as up to 15x, is very well known and established

  https://www.google.com/search?q=tokenizer+efficiency+by+language
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by isawczuk on Tuesday May 26, 2026 @01:24AM (#48275340)
Poland have its one LLM called Bielik. It's not only better in preserving Polish sounding wording, it's also better in writing government documents. Why better? They did arena and statistically it's just better.
Re:Norway's 2 petabytes of Huawei flash storage and LLM trai... by KaiserPro on Tuesday May 26, 2026 @03:10AM (#48276189)
could you provide evidence to suggest he is wrong?

It seems like you've made an assertion but not provided evidence. Why is it not a disadvantage to only have english LLMs?

Can you get the nuance of Norwegian history/culture with present models?