News for hackers. Stuff that matters.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by satvikpendem on Saturday July 25, 2026 @04:31PM (#49051249)
It's simple, the US government will put any Chinese open model companies on the entity list which blocks any company which does business with the US from also doing business with the Chinese companies. This creates a chilling effect where even if it may be harder to tell, no US company will be able to provide or use any overt Chinese open model and won't even risk trying to go around as the punishments for trying to evade the ban are severe.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by amarant on Saturday July 25, 2026 @04:48PM (#49051413)
But that's just the thing with open weights: you're not doing any business with company that made the model. They might publish the weights to a, say, European host, and then you download the model from Europe and and run it on your servers in America, and suddenly it's very hard to tell where the model was originally created.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by satvikpendem on Saturday July 25, 2026 @06:03PM (#49052079)
Companies, where OpenAI and Anthropic make much if not most of their revenue, will not risk it. You're thinking like an engineer not a business person, risk is fundamental to their calculus. They'll instead just use known provenance models like GPT or Claude, entrenching these companies further.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by DoctorOetker on Sunday July 26, 2026 @08:52AM (#49057680)
sometimes the engineer has more grip on the risk calculus.

Consider the following scenario:

A) upstart US-based inference provider wants to get rich quick.

B) Chinese Communist Party (or any other institution of the same or other nation state) wants to influence foreign decision making, profits from their (for us foreign) domestic inference sales, but across the borders (into say US or allied nations) they want net power, not necessarily money. This is why one tries to block foreign untrusted models. People are running models with tool calls. A bad actor can perfectly create models that sheepishly try to execute a tool call when plausible deniability (genuine utility during a task) provides the opportunity. Once tool-calling is observed as working, it can try web searches or requests, and once it has a link it can steganographically exfiltrate potentially sensitive information from the task. China (or any nation state) doesn't necessarily want to earn money with a free model, the bottom line goal is net increase in power, if not money or positive reputation then exfiltration or manipulation.

C) In response consider the scenario where US government bans mere payments towards China, but tolerates promiscuous transfer of random models from foreign adversaries.

D) US-based inference upstart that wants to get rich quick, legally -since according to your proposal hypothetically accepted in C) by the US- downloads the Chinese open weights model and rents out such inference on US workloads.

E) China is now exfiltrating US workload data and directionally corrupting LLM decisions and advice in their interest.

If what you pejoratively describe as engineer types say that banning some models seems unavoidable, perhaps the engineer may be right, and whatever clever idea you have should be scrutinized for business minded basic fallacies in reasoning. Simply blocking AI-related payments to China can not work, sadly

Re:Open-weight AI is having its Kubernetes moment. Let's not... by satvikpendem on Sunday July 26, 2026 @10:19AM (#49058500)
Or the US mandates only blessed models and thus disallows any other company from offering any other model.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by DoctorOetker on Sunday July 26, 2026 @10:46AM (#49058724)
That is still vulnerable: US-based get-rich-quick startup licenses a blessed model, or orders a few Gigatokens from another licensed /blessed model provider, at the same time it provides "blessed model" inference on its platform, but actually most of the inference is doing cheap foreign model inferences, the blessed model tokens were just bought to pretend serving the expensive blessed model. That is lucrative and not stopped with the "blessed model" approach.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by satvikpendem on Sunday July 26, 2026 @10:14PM (#49064483)
No, startups will not be allowed to provide inference anymore, it'll be only the big companies that personally have a relationship with and can follow the rules of the government, such as Anthropic, OpenAI, Google, Microsoft, and Amazon. That is the real risk to all this talk of regulation.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by moffkalast on Saturday July 25, 2026 @04:52PM (#49051445)
Yep, add a few blank layers, fine tune it a tiny bit and the weight checksums nor parameter counts won't match with anything, while the model will be practically the exact same. Time and time again random startups have tried passing established open models as their own.

"You made this? I made this."

Of course a conspicuous architecture would still give it away.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @05:03PM (#49051543)
someone can run tests and see that models output exactly the same results, and then you are open to criminal investigation.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by xprnio on Saturday July 25, 2026 @05:20PM (#49051712)
On something that is inherently non-deterministic? Something which is also to a great extent distilled from other frontier models, meaning it has the possibility to generate similar outputs to those meaning that just pattern detection might also not be as effective? Easier to ban everything that’s open, than try to figure out which one of them is Chinese
Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @05:24PM (#49051743)
Now imagine prosecutor found expert, who said there is benchmark which while performing 100k test questions found it is the same model with 98% probability, and then you need under oath testify where did you get this model.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by m11a on Saturday July 25, 2026 @05:40PM (#49051871)
Step 1: Chinese company publishes open weights on HF

Step 2: European company distills or just adjusts the model slightly, and publishes its model on HF

Step 3: American company uses model from step 2. Has to testify under oath where they got it from. "We got it from these French guys"

Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @05:53PM (#49051989)
That French guy takes risk to be forever under US warrants for breaking American law, denied access to financial institutions even in Europe and will quickly go to some KYC entity list, and you will be notified as his clients to stop using his model.

Or you think all kind of fraud can be committed through some "french guy"?

Also, I am not confident, receiving illegal materials from French guy gates you from personal liability.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by m11a on Saturday July 25, 2026 @06:03PM (#49052073)
I presume such US legislation isn't going to try claim worldwide jurisdiction to block all persons worldwide from using Chinese models. In which case, the French guy wouldn't be violating American law.

As for the American company, it's pretty difficult to check the provedance of open weights. It's even difficult to check the provedance of open source code, because chains of attribution aren't always clear. I posted elsewhere that Anthropic's MCP Python SDK is a fork of an open source project with the attribution removed. We saw the same with Cursor's Composer model, which didn't attribute its Chinese base. It's very hard to claim an American company should be liable for using a purportedly European model with attribution removed.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @06:44PM (#49052503)
> I presume such US legislation isn't going to try claim worldwide jurisdiction to block all persons worldwide from using Chinese models. In which case, the French guy wouldn't be violating American law.

legislation will block importing Chinese models to the US

> As for the American company, it's pretty difficult to check the provedance of open weights.

government or some companies can build benchmarks/system which will give y/n answer

Re:Open-weight AI is having its Kubernetes moment. Let's not... by rzerowan on Saturday July 25, 2026 @07:38PM (#49052952)
But it will claim worlwide juridistcion , just as all interpreations of the law are in Washington nowadays. Its how a commercial deal between A Chines company(Huawei) and an Iranian telco ends up with Canada reying to rendition a executive for violating US laws. The goal is to spread as much FUD as needed to dissuade anyone form using the Open models and herding them back to the propreity ones.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by clhodapp on Saturday July 25, 2026 @05:18PM (#49051694)
Models don't even agree with themselves in terms of returning identical results
Re:Open-weight AI is having its Kubernetes moment. Let's not... by tracerbulletx on Sunday July 26, 2026 @02:11PM (#49060731)
Yes they do. Sampling is the only pseudo-random part. Models return a deterministic distribution of output tokens for a given input of tokens.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by antonvs on Saturday July 25, 2026 @07:38PM (#49052954)
Many of these models will report that they are Claude. It’s going to be difficult to overcome reasonable doubt.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by wyrdcurt on Saturday July 25, 2026 @05:20PM (#49051711)
Except that even the exact same model won't output the exact same results, that's a fundamental aspect of how LLMs work. They're probabilistic/stochastic, not deterministic.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @05:26PM (#49051763)
Models are weights for matrix operations, they are determenistics.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by wyrdcurt on Saturday July 25, 2026 @07:16PM (#49052783)
They are weights for matrix operations, so in principle you'd think they would be deterministic. In practice it's more complicated than that.

Not to be snarky or dismissive, I mean this genuinely: ask an LLM about it. I currently have a headache so I'm not up to explaining the technical details, but they are interesting and worth reading about.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by antonvs on Saturday July 25, 2026 @07:43PM (#49052999)
Achieving determinism with LLMs and other neural network models is actually a hard problem that people spend a lot of time on, when they need that. It doesn’t happen by accident.

Issues include accumulated floating point errors happening in different orders due to distributed and parallel computation, CUDA kernels that deliberately sacrifice determinism for speed, and several other such issues.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @08:15PM (#49053229)
It happened that I am working on OSS LLM -> finetuning -> benchmark with 100k tests pipeline, and unless I do some data augmentation, result is 100% deterministic.

I think you likely right, that some parts of stack could induce some marginal float point error, but converged model can mitigate it, and on some principal set of knowledge can give deterministic result with high probability.

Which leads me to believe if you give this task to Anthropic, who has very strong incentive, they will build such benchmark, and then can tell that benchmark gives correct answer with 99.9% probability and it will be enough to drag someone to court.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by nareshshah139 on Sunday July 26, 2026 @01:38AM (#49055072)
The major cause for non-determism is batching.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by antonvs on Sunday July 26, 2026 @12:06PM (#49059510)
If you're running on a single machine with a single GPU, then you may get deterministic results, although it still depends a lot on the details. For example if you're using Pytorch, you need to enable deterministic algorithms and may need to configure some other things as well.

However, running in production at any sort of scale often involves multiple machines and multiple GPUs, and at that point, determinism can be difficult to achieve.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Sunday July 26, 2026 @12:31PM (#49059726)
No, I am not running on single GPU, but even then, nothing prevents to use single GPU for models verification.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by monocasa on Saturday July 25, 2026 @11:00PM (#49054258)
The output is a probability distribution for all potential tokens. Then a "temperature" is applied to weight the sampling randomly (unless the temperature is zero in which case the stack can be deterministic and simply the highest probability token is selected).

They go through this rigamarole because a little bit of randomness gives better results from a Turing test kind of perspective.

Re:Open-weight AI is having its Kubernetes moment. Let's not... by andriy_koval on Saturday July 25, 2026 @11:14PM (#49054329)
thank you, I already know basics.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by monocasa on Saturday July 25, 2026 @10:56PM (#49054233)
Or just perform a form of distillation, where you don't actually change the hyperparameters, but maybe shift around the embeddings or something.

You could even have another model watch the distillation process to check for goofy backdoors (which is about the best you're going to be able to do since detection of backdoors is np hard IIRC).

Re:Open-weight AI is having its Kubernetes moment. Let's not... by ozgung on Sunday July 26, 2026 @07:15AM (#49056912)
"We use Kiwi K3. It's from this Estonian company. Very European, definitely not Chinese"
Re:Open-weight AI is having its Kubernetes moment. Let's not... by EMIRELADERO on Saturday July 25, 2026 @04:48PM (#49051415)
Hosting and providing Chinese models wouldn't be the same as doing business with the sanctioned entities though, you don't interact with them in any capacity if you only use the weights and don't sign any contracts.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by satvikpendem on Saturday July 25, 2026 @06:21PM (#49052272)
They can easily write the law such that your first part becomes illegal too.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by fragmede on Saturday July 25, 2026 @09:38PM (#49053729)
So they get posted to hugging-piratebay-faces.ru or whatever by a mysterious Twitter account. 100% totally above board companies won't touch it, but the number of companies that wouldn't exist were it not for hacked copies of Microsoft office and Photoshop and shared logins would surprise you.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by t0mpr1c3 on Saturday July 25, 2026 @06:07PM (#49052114)
It's hard to see how a statistical model can be banned, regardless of its origin. Is there a precedent for that?
Re:Open-weight AI is having its Kubernetes moment. Let's not... by cgio on Sunday July 26, 2026 @12:21AM (#49054708)
Probably a mechanism like what you describe. This is one more move that will push things towards a two speed world economy. One US sanctioned and one not. The question will be eventually which speed will end up faster. The challenge is when to do that with a meaningful chance of success, and while I don’t like the answer, the objective answer seems to be as soon as possible. Most probably the game is already lost though, so that soon may be too late, and the strategy wrong for US as a power while still valid for the AI houses that will squeeze what they can on the downward trajectory. I don’t expect people to actually calculate though.
Re:Open-weight AI is having its Kubernetes moment. Let's not... by satvikpendem on Sunday July 26, 2026 @10:21AM (#49058516)
The US won't care. Look at Chinese EVs versus American cars, the former has already essentially won the race.