News for hackers. Stuff that matters.
Re:Anthropic is expanding to Colossus2. Will use GB200 by virgildotcodes on Wednesday May 20, 2026 @09:19PM (#48216609)
Here's a probably stupid question - if someone were unbounded by ethics and conceivably had enough power and connections to power to shield themselves from many consequences of their actions - and that person owned these DCs, could they in theory observe all the streams of tokens coming in and out of these models, and even exfiltrate copies of these models wholesale to have their own teams do what they will with them in the pursuit of building their own competitive models?

Or is there something fundamental in the way these models get deployed (encryption or something or than legal contracts?) at this scale that prohibits the owners of the infra from gaining this level of insight / access?

Re:Anthropic is expanding to Colossus2. Will use GB200 by tristanj on Wednesday May 20, 2026 @09:28PM (#48216674)
1) The situation you described would be covered under the contract between Anthropic and xAI, and that any violation of that would be subject to financial penalties and legal proceedings. The US has a robust corporate legal system, and disputes do get resolved through the court system, although in a slow and costly manner.

The contract can stipulate a penalty at a high enough amount to discourage this behavior.

2) Output from models & intra-datacenter communications can be encrypted if customers truly cared.

3) There is no reason do this, because there are far better ways to exfiltrate data from Anthropic models. Chinese companies are already doing this at an industrial scale where they are reselling Claude tokens for 10-20% of the cost while retaining the data to train their own models. https://www.chinatalk.media/p/how-to-buy-cheap-claude-tokens...

If we look at Deepseek V4-pro, created by Deepseek who Anthropic formally accused of harvesting Claude tokens at scale, it performs the same as Claude did 6 months prior.

Re:Anthropic is expanding to Colossus2. Will use GB200 by seydor on Thursday May 21, 2026 @01:36AM (#48218310)
I guess there's a reason why those Chinese companies are in china
Re:Anthropic is expanding to Colossus2. Will use GB200 by overfeed on Friday May 22, 2026 @01:27AM (#48232339)
Under US law, LLM outputs are not under copyright. Even if those companies were under the American jurisdiction[1], the worst thing they would be guilty of is a breach of ToS.

1. OpenRouter is based in New York, and offers a 1% discount when users enable logging of their inputs/outputs; it doesn't take a genius to figure out why they might incentivize that

Re:Anthropic is expanding to Colossus2. Will use GB200 by 47282847 on Thursday May 21, 2026 @05:48AM (#48220095)
> The US has a robust corporate legal system

Thanks for the chuckle. ;)

Re:Anthropic is expanding to Colossus2. Will use GB200 by rafram on Thursday May 21, 2026 @08:20AM (#48221463)
It does, though.
Re:Anthropic is expanding to Colossus2. Will use GB200 by pyrale on Thursday May 21, 2026 @08:27AM (#48221549)
It does until you're embedded enough with the surveillance system [1]. If a company was able to get immunity in the wat AT&T got it, no contract would protect the other side.

[1]: https://en.wikipedia.org/wiki/Hepting_v._AT%26T

Re:Anthropic is expanding to Colossus2. Will use GB200 by tristanj on Thursday May 21, 2026 @08:45AM (#48221776)
That case has nothing to do with contract law.
Re:Anthropic is expanding to Colossus2. Will use GB200 by whattheheckheck on Thursday May 21, 2026 @10:42PM (#48231356)
And the govt protects its citizens and God is real
Re:Anthropic is expanding to Colossus2. Will use GB200 by 47282847 on Friday May 22, 2026 @02:25AM (#48232646)
Yeah. Well.

I guess as a European I want the legal system to be robust in terms of protecting the citizen’s interests against corporations. I can see how you can also want robustness in terms of protecting corporate interests against citizens, so, yes, the statement remains technically true in terms of robustness.

In terms of justice, again as a European, I think of Justitia, the Roman Godess, who judges based on “ideals of truth, fairness, honesty and justice“, “applied without regard to wealth, power, or other status”, evaluating “the goodness of the heart”. I don’t see these values represented much in the US so-called “justice” system.

Both aspects sufficiently documented for example over and over again in Matt Levine’s financial reporting.

Re:Anthropic is expanding to Colossus2. Will use GB200 by rafram on Friday May 22, 2026 @11:30AM (#48237269)
None of those have anything to do with robustness.
Re:Anthropic is expanding to Colossus2. Will use GB200 by 47282847 on Friday May 22, 2026 @12:40PM (#48238266)
Huh?

Cambridge Dictionary: “the quality of being strong, and healthy or unlikely to break or fail”

I provided two dimensions in which I consider the US justice system to have failed. I can provide more. You of course can prioritize different dimensions, but that doesn’t invalidate that I am also talking about robustness. Robustness is not an absolute, but always an adjective - related to a specific aspect.

Re:Anthropic is expanding to Colossus2. Will use GB200 by danielfoster on Friday May 22, 2026 @05:48PM (#48242121)
The top-level discussed a theoretical risk of data being exfiltrated by third parties for training. Other comments discussed contract law and legal remedies, including Delaware’s excellent court system for handling business disputes.

None of this means you don’t have the same rights as an individual to enforce contract terms. I think the top commenters discussed corporate law because that is where most IP theft occurs, and corporate customers have strong contracts covering data protection.

Re:Anthropic is expanding to Colossus2. Will use GB200 by 47282847 on Tuesday May 26, 2026 @09:54AM (#48279923)
When I chuckle because of the idea that one sees the US corporate legal system as “robust”, and then give an explanation for why I (me! personally!) chuckled, what is the point of trying to argue? For what exactly?

To give yet another personal reason for my chuckle besides the ones I already gave: I don’t consider a legal system where I can simply move state when I don’t like the law not very robust. Or one that can “look back to (a mere) 200 years of case law” - especially given how that is being (re)interpreted in recent years.

That is my personal opinion. You’re entitled to your opinion, your definitions, your perspectives. I remain chuckling :) we don’t have to always agree or dig holes of rational debate, we can just find stuff funny or not. I volunteered why it is funny to me when that causes irritation with some. I read the high number of upvotes as potential agreement.

Re:Anthropic is expanding to Colossus2. Will use GB200 by tristanj on Thursday May 21, 2026 @08:54AM (#48221871)
It's an accurate statement. The US (specifically Delaware) has a world-class corporate law system. Delaware has a court dedicated to only corporate and commercial disputes, with 200+ years of case law.
Re:Anthropic is expanding to Colossus2. Will use GB200 by lovich on Thursday May 21, 2026 @06:01PM (#48229371)
Man, good thing no one’s ever done something like reincorporate Tesla and SpaceX in Texas after loosing a court case in said Delaware court and having a pissy fit about it.
Re:Anthropic is expanding to Colossus2. Will use GB200 by voxic11 on Wednesday May 27, 2026 @02:10PM (#48298156)
The state of incorporation doesn't often matter in interstate contracts. Usually they will include a choice of law and forum selection clause specifically to avoid this kind of thing.
Re:Anthropic is expanding to Colossus2. Will use GB200 by viking123 on Thursday May 21, 2026 @06:28AM (#48220381)
I hope the Chinese keep harvesting Claude etc. since they stole all their data anyway, who cares?
Re:Anthropic is expanding to Colossus2. Will use GB200 by stingraycharles on Thursday May 21, 2026 @07:13AM (#48220727)
> There is no reason do this, because there are far better ways to exfiltrate data from Anthropic models. Chinese companies are already doing this at an industrial scale where they are reselling Claude tokens for 10-20% of the cost while retaining the data to train their own models.

I think you missed the part where Anthropic stopped displaying their thinking tokens over the past few months, and instead now provides “summarized thinking”, letting Haiku summarize Opus’ thoughts.

So it is now much more difficult (impossible?) to distill the models.

I also think you over-estimate how well the legal systems works in the US nowadays, and under-estimate just how much power Elon has in the government.

Re:Anthropic is expanding to Colossus2. Will use GB200 by rfoo on Thursday May 21, 2026 @10:17AM (#48223004)
At this scale thinking tokens don't matter anymore.

In Feb Anthropic called out three Chinese labs for "distillation attacks", but a lab missing in their post actually had most Claude generated tokens among all Chinese labs in their midtrain data :p

Re:Anthropic is expanding to Colossus2. Will use GB200 by surgical_fire on Thursday May 21, 2026 @10:19AM (#48223059)
Incidentally, Claude started the "Summarized Thinking" bullshit around a year ago.

Deepseek kept its pace of improvement nonetheless.

Re:Anthropic is expanding to Colossus2. Will use GB200 by rdgthree on Wednesday May 20, 2026 @11:40PM (#48217600)
xAI had a lot of negotiating power here because Anthropic had ~0 comparable options and ultimately desperately needed the compute now. So, it wouldn't surprise me if data sharing was an explicit part of the agreement
Re:Anthropic is expanding to Colossus2. Will use GB200 by fragmede on Wednesday May 20, 2026 @09:26PM (#48216654)
There's accusations that the Chinese labs have done essentially that to OpenAI and Anthropic and exfiltrated their models without having DC access, so if you had DC access, yes, you could do that. If you had DC access though you could just copy the model onto an SSD.
Re:Anthropic is expanding to Colossus2. Will use GB200 by zozbot234 on Thursday May 21, 2026 @03:42AM (#48219182)
The Chinese labs have been accused of training on elicited chat logs on a massive scale in violation of ToS. That's possibly a real issue, but it's nowhere close to "exfiltrating" the model or even roughly matching its behavior.
Re:Anthropic is expanding to Colossus2. Will use GB200 by espeed on Thursday May 21, 2026 @02:16AM (#48218593)
What prevents a data center operator from reading your chats? [FEATURE] Provide a way to select your data center #56916 https://github.com/anthropics/claude-code/issues/56916
Re:Anthropic is expanding to Colossus2. Will use GB200 by giancarlostoro on Thursday May 21, 2026 @02:48AM (#48218798)
You could, but Grok is pretty high up there, it might not be "#1" but its definitely up there with the giants, people seem to overlook it. Gemini has a similar problem, it was #1 once, and it seems like Google isn't hell bent on chasing #1 they just want to keep iterating over time, they know they just need it to be "good enough" and they'll keep having repeat customers.

If Elon REALLY wanted to do anything like that he would be better off poaching talent from competitors, less legal hell to go through.

Re:Anthropic is expanding to Colossus2. Will use GB200 by petesergeant on Thursday May 21, 2026 @05:05AM (#48219780)
If I was training a top-tier model, having a competitors’ weights feels like it would be an excellent refining tool. As a user I find cross-model iteration to be a huge power-tool, and presumably the boffins can zero in on areas of relative strength and weakness and work out which area they want massive amounts of synthetic data from.
Re:Anthropic is expanding to Colossus2. Will use GB200 by jatora on Thursday May 21, 2026 @08:12AM (#48221371)
No Grok is not 'up there'. Not by any stretch of the imagination is it anywhere close to anthropic or openai in any single domain whatsoever. Not even close to deepseek. It really isnt a good model. Their research team's talent is just not good, unfortunately.
Re:Anthropic is expanding to Colossus2. Will use GB200 by scubbo on Thursday May 21, 2026 @10:01PM (#48231109)
> in any single domain

I hear that it is very much up there in _one_ domain. You know the one.

Re:Anthropic is expanding to Colossus2. Will use GB200 by mike_d on Thursday May 21, 2026 @07:49PM (#48230190)
You must have missed the part where he did poach all the top talent from Google and OpenAI, and then they all quit because they couldn't stand working for him.
Re:Anthropic is expanding to Colossus2. Will use GB200 by Traster on Thursday May 21, 2026 @04:32AM (#48219540)
It's already in the public domain (thanks to the OpenAI trial) that Grok distilled OpenAIs models. Listening to the data going into the models in the data centre would be very similar thing. There's some downsides (you're passively listening, not controlling the queries), and some upsides (way more data). But it only ever gets you to some percentage of the existing production model. It doesn't get you what Musk wants - an AI company capable of designing and deploying leading edge models. It gets you to fast follower status.
Re:Anthropic is expanding to Colossus2. Will use GB200 by Glohrischi on Thursday May 21, 2026 @07:02AM (#48220637)
Yes he could do that and I thought about this too. Very weird tbh
Re:Anthropic is expanding to Colossus2. Will use GB200 by HarHarVeryFunny on Thursday May 21, 2026 @07:50AM (#48221117)
Bear in mind these data centers were built for X.ai to use themselves, so there would have been no reason to backdoor them. Also, this is all off-the shelf equipment: Dell & Supermicro servers with NVidia compute modules and ethernet switches.
Re:Anthropic is expanding to Colossus2. Will use GB200 by killerstorm on Thursday May 21, 2026 @01:15PM (#48226052)
The fact that X.ai build it for themselves means that they are in full control. It's not challenging to install a rootkit on hardware under your control. Also if traffic within the datacenter is unencrypted, you can probably get copy of all comms via switches.

It's generally far easier to install spying software under a computer under your control than to detect it.

Re:Anthropic is expanding to Colossus2. Will use GB200 by __MatrixMan__ on Thursday May 21, 2026 @02:10PM (#48226799)
Given Musk's previous antics, this strikes me as a relevant line of reasoning.

How do you trust space infra? You can't show up and audit some kind of airgap. Whatever encryption keys you have are likely accessible in memory sometime.

Re:Anthropic is expanding to Colossus2. Will use GB200 by ncr100 on Friday May 22, 2026 @01:39AM (#48232421)
Could they also, if they owned a 10,300 vehicle fleet of orbiting satellites, add radar or optical surveillance to each, and track every human on planet early in real time?
Re:Anthropic is expanding to Colossus2. Will use GB200 by fragmede on Friday May 22, 2026 @02:07AM (#48232554)
Why would they need to do that, when the majority of those humans are already carrying a radio transceiver with them at all times.