News for hackers. Stuff that matters.
Re:Pirate Face Rescues LLM Models from Deletion by phoyd on Sunday September 20, 2026 @12:09PM (#49777198)
Torrents should really be the preferred method for distributing AI model weights. Why rely on a single point of failure like Hugging Face? BitTorrent was made for exactly this.
Re:Pirate Face Rescues LLM Models from Deletion by TeMPOraL on Sunday September 20, 2026 @12:20PM (#49777282)
Yeah, I thought they were used for this already. Surprised this is news, but also relieved.
Re:Pirate Face Rescues LLM Models from Deletion by Oxodao on Sunday September 20, 2026 @12:50PM (#49777531)
IIRC Mistral used to do it, not sure if that's still the case

EDIT/ Yes they did, that no longer seems to be the case though

https://x.com/MistralAI/status/1833758285167722836

Re:Pirate Face Rescues LLM Models from Deletion by CodesInChaos on Sunday September 20, 2026 @12:27PM (#49777353)
In my experience public torrents often die as they grow older. It doesn't help that BitTorrent V1 makes long term seeding annoying, and BitTorrent V2 is almost never used.
Re:Pirate Face Rescues LLM Models from Deletion by monsieurbanana on Sunday September 20, 2026 @12:42PM (#49777472)
I never understood this, is there anything that makes it difficult for the original uploader, the one that supposedly offers the file directly, to offer a torrent instead for the same amount of time?

As far as perennity is concerned it seems strictly better.

Re:Pirate Face Rescues LLM Models from Deletion by zenoprax on Sunday September 20, 2026 @12:55PM (#49777570)
Every change to the source is effectively a new torrent. This creates a ton of fragmentation as data is reorganized, remixed, reencoded, and so on.

You can see this with many Linux distros: there is no single Debian torrent that people seed for years because there's always a refreshed version.

Distros are a bad use case for P2P anyway since you depend on upstream as soon as you start upgrading and installing packages.

Re:Pirate Face Rescues LLM Models from Deletion by vova_hn2 on Sunday September 20, 2026 @02:46PM (#49778705)
IPFS has a solution [0] to this problem

[0] https://specs.ipfs.tech/ipns/ipns-record/

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @02:50PM (#49778757)
Most of IPFS doesn't actually work very well, if you've ever tried to use it
Re:Pirate Face Rescues LLM Models from Deletion by vova_hn2 on Sunday September 20, 2026 @03:04PM (#49778889)
> if you've ever tried to use it

Heh, you got me :) IPFS is one of those things that I love reading and about and thinking about using someday, but somehow never get around to it.

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @03:19PM (#49779057)
The problems begin with taking 5-10 minutes to locate a file on the network. That's right, when you ask for a file it takes 5-10 minutes. Also if the file isn't in the network at all then it never terminates.

Nobody noticed because everyone just used the central web gateway that cached every file anyone ever accessed.

Re:Pirate Face Rescues LLM Models from Deletion by chmod775 on Sunday September 20, 2026 @01:16PM (#49777796)
You can trivially have storage deduplication for the files served via torrent, transparent to the protocol. The most trivial version of this that you can do today with pretty much any client is having a single directory containing files serving multiple overlapping torrents.
Re:Pirate Face Rescues LLM Models from Deletion by skeledrew on Sunday September 20, 2026 @01:22PM (#49777876)
> files serving multiple overlapping torrents

This sounds wildly complex, especially from a discovery perspective.

Re:Pirate Face Rescues LLM Models from Deletion by chmod775 on Sunday September 20, 2026 @01:37PM (#49778007)
I don't see why it would be. It's transparent to other clients just like it is to the protocol. It cannot be more complex than alternatives by construction.
Re:Pirate Face Rescues LLM Models from Deletion by deadbunny on Monday September 21, 2026 @03:21AM (#49784068)
Or use a filesystem with dedupe like ZFS.
Re:Pirate Face Rescues LLM Models from Deletion by righthand on Sunday September 20, 2026 @01:10PM (#49777731)
> Distros are a bad use case for P2P anyway since you depend on upstream as soon as you start upgrading and installing packages.

This is true for any distribution method not just p2p. You can even download a nightly through torrents so what does it matter how the data is transferred if it’s always going to require `apt update`?

Re:Pirate Face Rescues LLM Models from Deletion by zenoprax on Sunday September 20, 2026 @04:18PM (#49779658)
Yeah, I just use the "netinstaller" ISOs since it's much smaller and never needs to be updated. If I had a need for air-gapped/offline installs I'd either download a larger ISO or just manually install packages from .deb as needed.
Re:Pirate Face Rescues LLM Models from Deletion by NooneAtAll3 on Sunday September 20, 2026 @01:28PM (#49777918)
but model releases are already non-changeable?
Re:Pirate Face Rescues LLM Models from Deletion by zenoprax on Sunday September 20, 2026 @03:59PM (#49779466)
Yes, models are a good use for P2P especially if everyone agrees to share the same torrent and someone (or a cohort) commit to seeding for the long haul.
Re:Pirate Face Rescues LLM Models from Deletion by cube00 on Sunday September 20, 2026 @12:46PM (#49777499)
If they're no longer using that model they may not be willing to continue using their storage for it.
Re:Pirate Face Rescues LLM Models from Deletion by vlyan on Sunday September 20, 2026 @01:42PM (#49778067)
yes, but a few dedicated hoarders could keep many models alive, and I'm fairly certain the local LLM community has plenty of people who would.
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @02:52PM (#49778769)
They don't. That's the conversation topic.

Nor do they need to. 99% of everything is crap, and not worth prescribing except for a random sample so future historians can study our crap.

Re:Pirate Face Rescues LLM Models from Deletion by csomar on Sunday September 20, 2026 @12:50PM (#49777536)
How does this address the previous point? If they are not providing storage, then centralized or decentralized doesn’t make a difference.

Torrent/P2P can only add redundancy, so it’s impossible to have worse availability than a download link?

[dead]
Re:Pirate Face Rescues LLM Models from Deletion by Wowfunhappy on Sunday September 20, 2026 @01:45PM (#49778102)
Well, for a torrent to stay healthy, users have to seed after download, so it can't possibly have the same UX as a standard browser file download unless you want to either kill the ecosystem or hide from the user what is consuming upload bandwidth.

That said, for large files, I much prefer the UX of a well-designed torrent client like Transmission to my web browser. If nothing else, the downloads are reliably resumable.

Re:Pirate Face Rescues LLM Models from Deletion by QuantumNomad_ on Sunday September 20, 2026 @05:16PM (#49780152)
> I much prefer the UX of a well-designed torrent client like Transmission to my web browser. If nothing else, the downloads are reliably resumable.

Brave browser had BitTorrent client built in for a while. I tried it a couple of times as I already use Brave for web browsing on my laptop. It was a very confusing BitTorrent client. I struggled to use it, and wasted time waiting for a download to complete only to not be able to find where the files were and then they disappeared. Using a decent BitTorrent client like you say is much preferable to the one that they had in Brave browser.

Re:Pirate Face Rescues LLM Models from Deletion by pell on Sunday September 20, 2026 @01:04PM (#49777657)
> Is there a fully in-browser torrent option that has the same UX as a regular file download in Firefox?

Opera did back in the day.

Re:Pirate Face Rescues LLM Models from Deletion by debugnik on Sunday September 20, 2026 @02:32PM (#49778564)
You can add an existing HTTP download as a "web seed" to a torrent, so they don't actually need to do anything for people to share it as a torrent.
Re:Pirate Face Rescues LLM Models from Deletion by bilegeek on Sunday September 20, 2026 @12:58PM (#49777600)
The biggest problem with BTv1 was the lack of per-file checksumming, and swarm merging (i.e. individual files have shared seeding pools across torrents). BTv2 specs the latter, but I think only BiglyBT actually implements it. Having both of those features from the get-go would've gone a LONG way to fixing the dead torrent problem.
Re:Pirate Face Rescues LLM Models from Deletion by Mindless2112 on Sunday September 20, 2026 @04:02PM (#49779498)
Re:Pirate Face Rescues LLM Models from Deletion by zenoprax on Sunday September 20, 2026 @12:45PM (#49777495)
You only need one person/organization to commit to seeding. The majority of people do not want to seed at all without some sort of incentive.

If this site represents a coordinated datahoarding effort then there will be at least a few people who will seed indefinitely.

Re:Pirate Face Rescues LLM Models from Deletion by csomar on Sunday September 20, 2026 @12:57PM (#49777588)
The last guy (kimdotcom) who was working on this (incentive for seeding) seems to be heading to the US: https://www.rnz.co.nz/news/science-and-technology/651123/cou...

It’s interesting he’s no longer getting any media attention any more.

Re:Pirate Face Rescues LLM Models from Deletion by Retr0id on Sunday September 20, 2026 @01:08PM (#49777708)
A torrent with a webseed is strictly more resilient than a direct download link alone.
Re:Pirate Face Rescues LLM Models from Deletion by ranger_danger on Sunday September 20, 2026 @12:54PM (#49777557)
I always wondered why v2 is never used... you can even search for files by their individual hash with it.
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @01:09PM (#49777725)
Because history is path-dependent, as engineers keep learning over and over again. It doesn't matter whether Plan9 is theoretically superior to Linux - we're all on Linux and nobody's porting all the apps over.
Re:Pirate Face Rescues LLM Models from Deletion by PunchyHamster on Sunday September 20, 2026 @06:45PM (#49780897)
Yeah but that's what provider like huggingface could just do, keep seeding the models so they are still accessible
Re:Pirate Face Rescues LLM Models from Deletion by boredumb on Sunday September 20, 2026 @01:07PM (#49777705)
ages ago I tried using IPFS to more or less accomplish this, I imagined it to act more like a weights/training data network fs that everyone would be able to participate in.
Re:Pirate Face Rescues LLM Models from Deletion by pmdr on Sunday September 20, 2026 @01:50PM (#49778156)
HF is meant to be a single point of control. AI models and Linux distros aren't usually for normies, so distribution via torrents would make sense, especially to save the provider some bandwidth. Ubuntu has been offering torrent downloads for ages. No mention of torrents on HF. I believe most downloads will soon be account/EULA-walled.
Re:Pirate Face Rescues LLM Models from Deletion by skeledrew on Sunday September 20, 2026 @12:15PM (#49777255)
Arguably this should've been a thing since day 1 (and probably would've helped to prevent the buyout), but better late than never.
Re:Pirate Face Rescues LLM Models from Deletion by RobotToaster on Sunday September 20, 2026 @12:21PM (#49777286)
Hugging face seemed like buyout bait from day one.
Re:Pirate Face Rescues LLM Models from Deletion by hirako2000 on Sunday September 20, 2026 @01:16PM (#49777789)
The GitHub for models and AI. I remember.

When a business subsidizes for several years all its offerings, one can guess how it will end.

Re:Pirate Face Rescues LLM Models from Deletion by Avicebron on Sunday September 20, 2026 @12:24PM (#49777321)
Which makes it more surprising that something like this didn't exist. I'm relieved it does though.
Re:Pirate Face Rescues LLM Models from Deletion by kevinsimper on Sunday September 20, 2026 @12:07PM (#49777183)
That is pretty smart, torrent should have been used for more things, and this is a perfect usecase!
Re:Pirate Face Rescues LLM Models from Deletion by yieldcrv on Sunday September 20, 2026 @12:15PM (#49777251)
great initiative, it's really weird seeing efficiencies get rediscovered in the LLM audience, because these efficiencies aren't even what I would consider to be old

but I guess they are

Re:Pirate Face Rescues LLM Models from Deletion by casper14 on Sunday September 20, 2026 @12:24PM (#49777316)
Honestly, models are torrents will end any effort from the big AI labs to stop open models. No way to prevent weights from being shared, just like mobies. Genie is out of the bottle
Re:Pirate Face Rescues LLM Models from Deletion by mococa on Sunday September 20, 2026 @12:27PM (#49777351)
Steam & Blizzard (probably others) used to delivery games through torrent protocol in the past, before CDNs became cheaper.

When StarCraft 2 was lauched, the installer (before Battle.net installer crapware) had a complete graphical visualization of seeders & leechers.

Reference: https://warcraft.wiki.gg/wiki/Blizzard_Downloader

Re:Pirate Face Rescues LLM Models from Deletion by bayindirh on Sunday September 20, 2026 @12:50PM (#49777535)
Oh, story time:

Once I was using Blizzard's downloader to install something (StarCraft, Diablo, I don't remember), and it was kinda slow. I disabled P2P downloads and speed skyrocketed, and I said "Huh, this was unexpected".

When P2P downloads disabled you could see the list of CDNs you're downloading from and mine had a single IP on that list. It looked familiar. Then it dawned on to me. It was the Akamai server which we were hosting in our system room, at 15 minutes of driving distance. After a chuckle, I went to get a cup of tea, because that was entertaining than the game itself.

Then of course, I dived into whatever I was installing that night.

Edit: From the screenshots in the wiki, I remembered that the progress bar was red. It was possibly Diablo 3, then. However, I'm still not 100% sure about it.

Re:Pirate Face Rescues LLM Models from Deletion by skeptic_ai on Monday September 21, 2026 @01:02AM (#49783238)
So how come was using your own ip? Become a Diablo node installer so you downloaded from there, like how can they convert your own akamai instance into anode without you knowing?
Re:Pirate Face Rescues LLM Models from Deletion by bayindirh on Monday September 21, 2026 @02:14AM (#49783606)
It's not my own IP, but our IP block. As an institution we have a couple of big networking related hats, so we have a couple of B blocks (/16 networks) for ourselves. The IP was from one of these blocks.

However, these network operations (and CDN related stuff) are not managed by us, but by a couple of high profile guys next door. I knew we had an Akamai node, because the machines were shipped recently and we had a chat about it.

Funnily, some of the performance optimizations on Akamai's disk access algorithms (SSDs were not dime a dozen back then, so people were still optimizing for spinning drives) was apparently developed by a friend of mine, but I don't know any details about that.

Re:Pirate Face Rescues LLM Models from Deletion by alexpotato on Sunday September 20, 2026 @12:31PM (#49777379)
I've worked at trading firms where the "reference data master" file is usually a big json or equivalent.

To get the file out to 100s or 1000s of machine they would often use private bittorent to distribute the file out.

Re:Pirate Face Rescues LLM Models from Deletion by ehe78qhe on Sunday September 20, 2026 @02:13PM (#49778378)
I've seen this used for distributing container images in networks with awkward network topologies (e.g. a lot of bandwidth within a site or sub-site but limited bandwidth to central registries)
Re:Pirate Face Rescues LLM Models from Deletion by mococa on Sunday September 20, 2026 @12:33PM (#49777396)
Same here. Inspired by both, I used to delivery videos over torrent to in door machines since at that time, there's no CDNs (or it was difficult to get one).
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @01:11PM (#49777740)
As a private network, they have the option of multicast.
Re:Pirate Face Rescues LLM Models from Deletion by alexpotato on Sunday September 20, 2026 @03:42PM (#49779301)
When I retire and/or get "F You" money, I'm going to publicly tell a story about multicast, bittorrent and "not invented here" syndrome.
Re:Pirate Face Rescues LLM Models from Deletion by ehe78qhe on Sunday September 20, 2026 @02:14PM (#49778388)
Steam has a limited form of p2p delivery, used on LANs: https://help.steampowered.com/en/faqs/view/46BD-6BA8-B012-CE...
Re:Pirate Face Rescues LLM Models from Deletion by Aurornis on Sunday September 20, 2026 @12:57PM (#49777595)
Several companies tried this for distributing software.

It was very controversial. Users were angry that software companies were using their internet bandwidth to distribute their software. Made a lot of people angry.

Re:Pirate Face Rescues LLM Models from Deletion by blharr on Sunday September 20, 2026 @03:45PM (#49779345)
>software companies were using their internet bandwidth to distribute their software

If I understand the description correctly, microsoft still does this!

https://support.microsoft.com/en-us/windows/privacy/windows-...

Re:Pirate Face Rescues LLM Models from Deletion by himata4113 on Sunday September 20, 2026 @04:14PM (#49779611)
Steam still does this! For your local network only and not using the torrent protocol.
Re:Pirate Face Rescues LLM Models from Deletion by ivanmontillam on Sunday September 20, 2026 @01:44PM (#49778090)
If only Blizzard servers were seeders, and clients were only leechers, that'd have not been a problem.
Re:Pirate Face Rescues LLM Models from Deletion by ehe78qhe on Sunday September 20, 2026 @02:11PM (#49778362)
This is less efficient (in bandwidth, complexity, and monetary cost) than an HTTPS based CDN.
Re:Pirate Face Rescues LLM Models from Deletion by mococa on Sunday September 20, 2026 @02:15PM (#49778393)
There’s web seeding
Re:Pirate Face Rescues LLM Models from Deletion by x-complexity on Sunday September 20, 2026 @10:47PM (#49782499)
That's just a CDN, but now it's not HTTP accessible (thus strictly worse).
Re:Pirate Face Rescues LLM Models from Deletion by kzrdude on Sunday September 20, 2026 @02:04PM (#49778278)
Typical example to show that people who want to be angry will be angry, even for pointless things.
Re:Pirate Face Rescues LLM Models from Deletion by mh- on Sunday September 20, 2026 @02:36PM (#49778605)
As someone who was annoyed by it at the time, I don't think it's a good example of that.

This was in an era of much more limited upstream bandwidth. The p2p nature was obscured from non-technical users in some implementations. So on and so on. I'm sure there are plenty of writeups from that era detailing why it was a bad idea.

These companies already used capable CDNs to distribute patches. It was a way for them to shift their CDN bill onto their paying customers.

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @02:54PM (#49778802)
I think it's like residential proxies. People get upset about "it's using my thing!" even though it has literally no effect on them.
Re:Pirate Face Rescues LLM Models from Deletion by mh- on Sunday September 20, 2026 @02:59PM (#49778839)
I don't know how to respond to that, because it has quite a few negative effects on them..
Re:Pirate Face Rescues LLM Models from Deletion by bayindirh on Sunday September 20, 2026 @06:04PM (#49780545)
When you have barely the upstream bandwidth to send the ACK stream of your downloads, anything sending something becomes a big burden on your system.

Not everyone has the luxury of fully symmetric internet connections even in this age. Yes, my uplink speeds are absurd when compared to a decade ago, but when I ratio it to my downlink, it's still slow.

I have no comment on residential proxies. Somebody doing something in my name is unacceptable to put it very mildly.

Re:Pirate Face Rescues LLM Models from Deletion by bananaflag on Sunday September 20, 2026 @12:27PM (#49777352)
Now I want GPT-4.5
Re:Pirate Face Rescues LLM Models from Deletion by reilly3000 on Sunday September 20, 2026 @12:33PM (#49777390)
I’ve been wondering when this will come. The days are numbered for abliterated models to be published on HF I think. Why wouldn’t the government want a central control there?
Re:Pirate Face Rescues LLM Models from Deletion by grommz on Sunday September 20, 2026 @12:35PM (#49777418)
If I search for 'uncensored' there are no torrents available. Uncensored models should be top priority, especially now that Nvidia owns HuggingFace and will enshittify the platform in accordance with upcoming US laws.
Re:Pirate Face Rescues LLM Models from Deletion by sneurlax on Sunday September 20, 2026 @12:38PM (#49777433)
There are such results on huggingface tho. Also search for the keywords “abliteration” and “heretic”. Heretic is a tool used to abliterate, that is decensor, models
Re:Pirate Face Rescues LLM Models from Deletion by behole on Sunday September 20, 2026 @12:45PM (#49777493)
That was my my first search too. I know they are still listed on HF but every time I try and use one, the links are dead or the size is beyond my scope. Was hoping for a fresh batch. Ill check back.
Re:Pirate Face Rescues LLM Models from Deletion by hgoel on Sunday September 20, 2026 @12:49PM (#49777526)
Torrents always seemed like the more sensible way to distribute model weights.

Though I have been disappointed that most of these have been spurred on by the misleading claim that abliterated models were being taken down from HuggingFace because they removed an abliterated model. HF took one abliterated model down because the uploader was spamming people who requested access with sketchy requirements to pay for it.

Plus, there are a bunch of these types of sites, all of them have a couple of models and otherwise completely dead.

There's also the problem of catching malicious models that have been fine tuned to exfiltrate credentials. It would be nice to have means of checking hashes against the HF versions (or against other reputable sources). I'm guessing this is probably easy when just serving the same folder as what HF serves.

Edit: I should've scrolled down on the page, it does verify against the HF hashes.

Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @12:57PM (#49777594)
Speaking to the "uncensored model" angle: there's little reason to distribute abliterated weights anyway. Instead of orthogonalising the weights that write back to the residual stream, you can just orthogonalise the activations themselves. It's equivalent.

Orthogonalising activations at runtime is computationally cheap. Just distribute the refusal vectors (few thousand floats per layer), then run against the stock weights. Antirez's DS4 already supports this: https://github.com/antirez/ds4/blob/8db1d1d155cb0400a86a86b9...

Abliterated weights are just a bad habit we've gotten into. It's also deeply suboptimal from a precision point of view to take a model that's already been QATed and distributed in pre-quantised form (DeepSeek V4, Kimi K2.5 or K3...), modify its weights, and re-quantise it. Similarly, abliterated models regain some of their refusal behaviour when they're re-quantised after abliteration -- avoidable by keeping the two separate.

Re:Pirate Face Rescues LLM Models from Deletion by derefr on Sunday September 20, 2026 @02:01PM (#49778248)
I believe abliterated models are mostly still created at this point because they're "universal": they can not only be run locally, and on cloud GPUs, but also on "managed inference" providers (i.e. services where you hand them a model URI, and they blindly fetch it, load it, and give you inference access to it through standard text/chat-completion APIs. Think HuggingFace Spaces, or Google CoLab, or CloudFlare Workers AI.)

Such managed inference providers have (for now) plausible deniability of behaving ethically (at least enough that they don't get boycotted / scare away investors) due to them being "blind" to what gets run on their systems. They're acting as the inference equivalent of data transit carriers.

But I don't think it would be possible for managed inference providers to publicly expose "runtime activation steering" in the way antirez's DS4 does, without that reading much more explicitly as them inviting unethical workloads.

(Yes, there are other things you can do with runtime steering. But almost all of those things are workload-specific, relying on you privately tuning to the needs of your own dataset. And if you can do that, you can run inference without the help of a managed inference provider. The only time a customer will come along with a pre-made runtime-steering vector file in hand, is if that vector is an alignment-orthogonalization vector.)

Re:Pirate Face Rescues LLM Models from Deletion by quotemstr on Sunday September 20, 2026 @10:32PM (#49782415)
These providers can also just ignore insinuations they're being "unethical" when people come to them with steering vectors in hand. Nobody has to listen to the scolds.
Re:Pirate Face Rescues LLM Models from Deletion by derektank on Monday September 21, 2026 @12:28AM (#49783063)
Not if those people are legislators or law enforcement
Re:Pirate Face Rescues LLM Models from Deletion by c7b on Sunday September 20, 2026 @02:53PM (#49778793)
Interesting. Is there a paper that explains this in a bit more detail, like [0] for abliteration (underlying the Heretic software, afaik)?

[0] https://arxiv.org/abs/2406.11717

Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @02:59PM (#49778842)
That paper you linked has all of the information you need. The linear algebra they do on the weights there to null out one direction reduces to a single (dot-product + broadcast-multiply + add) on the activations.
Re:Pirate Face Rescues LLM Models from Deletion by khalic on Sunday September 20, 2026 @03:57PM (#49779447)
I didn’t know about that method, thank you. I’ve needed a local model for security research but Qwen 27b abliterated did 30% worse than the stock weights on my internal benchmarks (I just skip the public benches now, it’s honestly useless noise on an operational level).
Re:Pirate Face Rescues LLM Models from Deletion by jamienk on Sunday September 20, 2026 @01:04PM (#49777659)
Can you explain this a bit to a non-expert?

I haven't wrapped my mind around this

Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @01:10PM (#49777730)
This is the original description of abliteration and it's quite approachable and interesting to read: Refusal in Language Models Is Mediated by a Single Direction (https://arxiv.org/abs/2406.11717). Warning: changes to your world view caused by seeing "HarmBench" used to maximise expected harm instead of minimising it may be irreversible.

There's an empirical observation that models often have a single direction in their activation space for "hmm no I shouldn't do this". It forms naturally during pre-training, and is then surfaced during post-training to make the model refuse to engage in certain behaviour.

With a little bit of linear algebra you can zap that direction from the model's activations, and it stops refusing to do things. You can also do the opposite: magnify that direction, and the model refuses to do anything at all.

Re:Pirate Face Rescues LLM Models from Deletion by schoen on Sunday September 20, 2026 @03:58PM (#49779453)
I'm pretty sure this was achieved with prompting rather than with weights, but there is a chatbot available that tries to maximize the motivated refusals:

https://www.goody2.ai/chat

Re:Pirate Face Rescues LLM Models from Deletion by chermi on Sunday September 20, 2026 @02:32PM (#49778567)
Damn what's happened since this? Presumably they scramble refusal intentionally somehow now? Like intentionally couple it to "directions" that effect performance if messed with? Or is it more like just don't rely on the model to refuse and instead capture bad responses between generation and delivery?
Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @02:48PM (#49778724)
I've seen attempts to obfuscate the refusal direction, like here: https://arxiv.org/html/2608.18093v1

Also this one was interesting, training the model to give preambles with reasons for the reasons for refusal seems to make it less sensitive to modulating the single refusal direction: https://arxiv.org/html/2505.19056v1

My empirical observation is that when a new model is released on HuggingFace, an abliterated version with < 10/100 refusals (baseline usually 100/100) is uploaded the same day, so either these techniques don't work very well or the open-weight labs aren't applying them.

There's some defense-in-depth, like a lot of the "guardrails" people hit on cloud models are classifiers applied to prompt or output, not a refusal generated by the model. Also closed-weight models obviously try to avoid this by not letting you see or modify the weights.

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @02:45PM (#49778700)
I'm not active in this space but why do you think anything happened since this? As far as I know, it still works.
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @01:07PM (#49777703)
Instead of editing the weights so they don't create the refusal signal, just let them do whatever, then delete the refusal signal itself. You don't want to edit quantised weights because it causes a loss of precision that can be pretty bad.
Re:Pirate Face Rescues LLM Models from Deletion by nperez on Sunday September 20, 2026 @02:46PM (#49778704)
Yeah I use a custom fork of llama.cpp that has an abliteration feature that basically does this. It's sloppily vibe coded and I don't have time to coordinate on a way to do this cleanly upstream, but it's absolutely possible and saves a lot of time and bandwidth from being wasted
Re:Pirate Face Rescues LLM Models from Deletion by rhdunn on Sunday September 20, 2026 @01:41PM (#49778055)
So... distribute a LoRA (or equivalent) that modifies the base weights with the abliteration vectors. That makes sense as it would be possible to try different abliterations and keep the storage space down.
Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @01:50PM (#49778154)
Yeah, orthogonalisation is a special case of a rank-1 LoRA.
Re:Pirate Face Rescues LLM Models from Deletion by ziofill on Sunday September 20, 2026 @05:09PM (#49780100)
I don’t think this is true.
Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @05:49PM (#49780453)
Could you please explain why? It's an additive update to the weights, adding an outer product of a vector with its transpose, which must have rank 1. What am I missing?
Re:Pirate Face Rescues LLM Models from Deletion by ziofill on Tuesday September 29, 2026 @08:33PM (#49902847)
You can’t diagonalize a generic matrix by adding a rank 1 matrix. That holds only for dimension 2.
Re:Pirate Face Rescues LLM Models from Deletion by 3eb7988a1663 on Sunday September 20, 2026 @01:43PM (#49778079)
Who is offering the refusal vectors or instructions on how to generate them?
Re:Pirate Face Rescues LLM Models from Deletion by wren6991 on Sunday September 20, 2026 @01:49PM (#49778136)
Here's a widely used toolkit: https://github.com/p-e-w/heretic

Distributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage.

Re:Pirate Face Rescues LLM Models from Deletion by p-e-w on Sunday September 20, 2026 @01:48PM (#49778126)
I am, in fact, I’m offering something much better, a compact format that exactly restores an abliterated model from a tiny JSON file:

https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC

Re:Pirate Face Rescues LLM Models from Deletion by doublerabbit on Sunday September 20, 2026 @02:26PM (#49778495)
> Similarly, abliterated models regain some of their refusal behaviour when they're re-quantised after abliteration

Thanks for this information, Q4 seemed fine but they reappeared again in Q5 with an vengeance, I couldn't understand why. Very Strict and I've only found one jail break that barely works around 60% of the time.

Re:Pirate Face Rescues LLM Models from Deletion by djmips on Sunday September 20, 2026 @06:49PM (#49780929)
A question that comes up in my mind, since I don't fully understand how this works, is how does this affect runtime performance. It feels like abliterated weight models would work faster than some extra runtime operations?
Re:Pirate Face Rescues LLM Models from Deletion by fc417fc802 on Sunday September 20, 2026 @09:16PM (#49781932)
The vector that needs to be checked is length n while computing that vector requires n^2 operations. I haven't benchmarked it but I expect the performance overhead to be a rounding error.
Re:Pirate Face Rescues LLM Models from Deletion by Razengan on Sunday September 20, 2026 @12:59PM (#49777607)
So begins the Merovingian and the Exiles..
Re:Pirate Face Rescues LLM Models from Deletion by wolfy1993 on Sunday September 20, 2026 @01:01PM (#49777630)
I'd support this if I didn't have to post to xitter to claim my username.

Really odd approach.

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @03:17PM (#49779026)
You can also use HN but your HN account will be either shadow banned or rate limited because then you are spamming.
Re:Pirate Face Rescues LLM Models from Deletion by QuantumNomad_ on Sunday September 20, 2026 @05:38PM (#49780348)
Instead of telling people to post spam in the thread, they should do the same way that is done for example by these:

- https://meet.hn/

- https://book.keybase.io/account#adding-proofs

Those tell you to put a text in your HN profile “about” section.

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @06:53PM (#49780956)
I don't think the point is to link the HN account to the PF account. I think the point is to spam HN.
Re:Pirate Face Rescues LLM Models from Deletion by jamienk on Sunday September 20, 2026 @01:14PM (#49777773)
Let's imagine that a model is pulled from HF by order of the new overlords or because of some other kind of censorship. Wouldn't the question of it having a Free license or not potentially become a complex legal issue?

But if the point is to be "censorship-free" then why respect licenses at all? They are among main choke points today. If authoritarians use licenses to censor political, artistic, scientific, etc., speech that they want to block, does that make the censorship more respectable?

When Anthropic sues a Chinese lab for IP infringement and get a court to put a bar on that software, does it THEN get pulled from Pirate Face?

I know that an awful lot of international negotiations have become focused more and more on questions of "IP" - licensing battles are already intensely politicized and it's hard to imagine a future where it doesn't get much much worse. Imagine N Korea coming after you for violating a license that they worked hard to control and leverage.

Re:Pirate Face Rescues LLM Models from Deletion by mannyv on Sunday September 20, 2026 @01:29PM (#49777933)
I can see all these old models hanging out and bitching about the newfangled models that think they're so great.

"Trillions of parameters? Trillion my ass. Back in my day we got by with millions. And now here we are, washed up has beens."

Re:Pirate Face Rescues LLM Models from Deletion by mmaunder on Sunday September 20, 2026 @01:41PM (#49778056)
Edit: Deleted. Been oversharing a bit re research I'm doing, and the payoff is replies from folks who haven't bothered to go and take a look themselves, which I then have to spend more cycles refuting, etc. So best to just go back to the first step and not overshare and recover the cycles I'd spend on the rest of it. Admittedly I'm tired and pissed off, but yeah. HN won't let me delete this so I guess it's just a deletion edit. Sorry.
Re:Pirate Face Rescues LLM Models from Deletion by chuckadams on Sunday September 20, 2026 @02:08PM (#49778324)
> DS 4.1 Flash, which is unguardrailed

Try asking it about Tianmen Square. I use DS myself, but let's not kid ourselves.

Re:Pirate Face Rescues LLM Models from Deletion by quaintdev on Sunday September 20, 2026 @02:24PM (#49778474)
For that specific query, just use US open weight model, oh...wait
Re:Pirate Face Rescues LLM Models from Deletion by hostcontroller on Sunday September 20, 2026 @03:09PM (#49778948)
open wait
Re:Pirate Face Rescues LLM Models from Deletion by KerrAvon on Sunday September 20, 2026 @01:57PM (#49778210)
DS 4.1 Flash absolutely has guardrails. Maybe not ones as effective as some models.
Re:Pirate Face Rescues LLM Models from Deletion by dist-epoch on Sunday September 20, 2026 @01:49PM (#49778143)
The FBI doesn't come busting down your door for pirating a few movies (I'm sure someone will find a news article with this happening).

They will after a few incidents where unguardrailed local models are used to hack and stop the water supply.

ThePirateBay is tolerated. Market places where drugs/guns are sold are not, they are all infiltrated and shut down after a while.

Re:Pirate Face Rescues LLM Models from Deletion by KerrAvon on Sunday September 20, 2026 @01:55PM (#49778196)
>They will after a few incidents where unguardrailed local models are used to hack and stop the water supply.

This is irrational AI fearmongering. Please read https://sharptext.net/2026/some-of-all-fears/

> Market places where drugs/guns are sold are not, they are all infiltrated and shut down after a while.

might want to look up "gun show loophole"

Re:Pirate Face Rescues LLM Models from Deletion by aftbit on Sunday September 20, 2026 @02:26PM (#49778497)
>might want to look up "gun show loophole"

I've never understood this. There is no "gun show loophole" anymore, if there ever was. Some states have two different standards required things like background checks and identification for gun sales between private party sales and dealer sales. If a dealer goes to a gun show, they have to background check their buyers just like anywhere else. Similarly, if a private party (in a state where they're not required to background check) sells a gun on Craigslist, they're equally unrequired to background check.

Many states, including most of the "anti-gun" states, have moved to requiring background checks from all sellers, including person-to-person transfers and even gifts from family.

The "gun show loophole" is massively overblown. There's nothing special about gun shows in it.

Re:Pirate Face Rescues LLM Models from Deletion by yandie on Sunday September 20, 2026 @03:50PM (#49779383)
https://en.wikipedia.org/wiki/Universal_background_check#Sta...

22 states only - are you sure that “most states” have blocked this?

Re:Pirate Face Rescues LLM Models from Deletion by frumplestlatz on Sunday September 20, 2026 @05:38PM (#49780340)
That counts as many states, and most of the "anti-gun" states, which is what the parent actually said.

Personally, I think people should be as free as possible to sell goods privately without the government getting involved. It's not a loophole, it's how things should work.

If you think any of these laws prevent felons and other prohibited persons from getting guns, you must be remarkably unfamiliar with felons, and their willingness to commit felonies. Most felons I know through friends/family have a gun (often stored somewhere plausibly deniable), and it's not a particular secret.

These laws primarily harm law-abiding citizens — who were never the problem in the first place — far more than they restrict prohibited persons from acquiring guns.

The same thing will occur with restrictions on open models, but arguably the results are far more harmful — limiting the technological and economic capacity of the people and countries we have to worry about the least, leaving the playing field open for those we have to worry about the most.

Re:Pirate Face Rescues LLM Models from Deletion by marcus_holmes on Sunday September 20, 2026 @09:37PM (#49782067)
You appear to have a fascinating mental model where the world is divided into "felons" and "law-abiding citizens".
Re:Pirate Face Rescues LLM Models from Deletion by frumplestlatz on Monday September 21, 2026 @01:24AM (#49783342)
“If you think any of these laws prevent felons and other prohibited persons …”

The three major categories of prohibited persons are felons, domestic abusers, and habitual drug users.

Guess what all three have in common?

Re:Pirate Face Rescues LLM Models from Deletion by marcus_holmes on Monday September 21, 2026 @01:48AM (#49783463)
They're mostly male?
Re:Pirate Face Rescues LLM Models from Deletion by frumplestlatz on Monday September 21, 2026 @02:09AM (#49783581)
They've demonstrated comfort with and a capacity for ignoring the law.
Re:Pirate Face Rescues LLM Models from Deletion by marcus_holmes on Monday September 21, 2026 @08:52PM (#49795500)
That's a tautology though. You're defining a set of people by their illegal behaviour and then saying "all of these people have a demonstrated comfort with a capacity for ignoring the law". Well, yes, obviously.

My point earlier was that people don't neatly sort themselves into "law-abiding citizens" and "felons" until after they've committed a crime. A law-abiding citizen can turn into a felon at any moment.

And, of course, this is in the context of the gun control debate, where you can't issue guns to only law-abiding citizens because you have no clue which of those law-abiding citizens are going to commit a felony and magically become a felon

Re:Pirate Face Rescues LLM Models from Deletion by frumplestlatz on Monday September 21, 2026 @10:34PM (#49796180)
You’re confusing definition with inference.

Of course "a felon has previously committed a felony" is tautological. But "a person who has committed a felony is substantially more likely to commit serious crimes in the future" isn't.

It's a well-established empirical claim, and that's why they're prohibited persons.

As for magically predicting whether someone will become a prohibited person: we can’t, and even if we could, that would mean preemptively restricting a constitutional right.

Re:Pirate Face Rescues LLM Models from Deletion by marcus_holmes on Wednesday September 23, 2026 @08:53PM (#49824795)
Right, so your future felon is a law-abiding citizen now.

> These laws primarily harm law-abiding citizens — who were never the problem in the first place — far more than they restrict prohibited persons from acquiring guns.

When you sell a gun to a law-abiding person, you have no idea if that person is going to become a felon or not. There is no hard line between the two, any law-abiding person can become a felon at any point.

This is why the rest of the world restricts people from owning guns.

Re:Pirate Face Rescues LLM Models from Deletion by aftbit on Tuesday September 22, 2026 @11:49AM (#49803260)
Fun fact - habitual drug users are no longer blanket prohibited from possessing firearms in the US, at least according to UNITED STATES v. HEMANI, decided by the Supreme Court this summer.

Of course it's not quite that simple. Among other things, the form to buy a firearm still asks if you are a user of controlled substances, and lying on the form is presumably still a felony.

The opinion is still a fascinating read and IMO a huge step forward.

https://www.supremecourt.gov/opinions/25pdf/24-1234_g2bh.pdf

Re:Pirate Face Rescues LLM Models from Deletion by dist-epoch on Sunday September 20, 2026 @02:04PM (#49778276)
> This is irrational AI fearmongering.

I said AFTER. If it doesn't happen, the local models will not be made illegal. So if you are right, you have nothing to fear.

Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @02:48PM (#49778736)
After nginx blows up a city, it'll be illegal to run or have a copy of nginx.

"But nginx won't blow up a city..."

Relax. If it doesn't happen, your nginx is safe.

Re:Pirate Face Rescues LLM Models from Deletion by sandcat_ on Sunday September 20, 2026 @01:48PM (#49778119)
What on earth is going on with all the spam in this thread? Is this how you claim a username?
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @03:17PM (#49779033)
Yes. This thing literally makes you spam HN in order to sign up. And for that reason this submission should be flagged.
Re:Pirate Face Rescues LLM Models from Deletion by itomato on Sunday September 20, 2026 @08:42PM (#49781696)
Yes, and then delete or edit the comment.
Re:Pirate Face Rescues LLM Models from Deletion by JonChesterfield on Sunday September 20, 2026 @03:08PM (#49778938)
That or X...
Re:Pirate Face Rescues LLM Models from Deletion by JonChesterfield on Monday September 21, 2026 @08:31AM (#49786454)
Turns out that the HN flagging mechanism hides the message from their auth check, so the spam doesn't actually work anyway. Oh well.
Re:Pirate Face Rescues LLM Models from Deletion by golem14 on Sunday September 20, 2026 @01:52PM (#49778169)
I wish they had used a better name. Why try to make it sound sinister and adjacent to piratebay etc? It's not that these models are illegal to own or download.
Re:Pirate Face Rescues LLM Models from Deletion by bicepjai on Sunday September 20, 2026 @01:53PM (#49778176)
You did not have to call it “pirate”. That kind of set the negative tone for the website, and all the comments are looking at it with that view from the start. But it’s a great emoji Lego. I am working on something similar, mainly to make the download faster. I notice when you download these weights it will faster initially but very soon the throughput goes down after sometime.
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @03:16PM (#49779015)
Piracy has a positive tone for me. It implies liberating information.
Re:Pirate Face Rescues LLM Models from Deletion by __MatrixMan__ on Sunday September 20, 2026 @07:49PM (#49781369)
Aye!

Pro-democracy Protesters of the Caribbean just doesn't have the same ring to it.

Re:Pirate Face Rescues LLM Models from Deletion by toomuchtodo on Sunday September 20, 2026 @02:34PM (#49778580)
Mirror the magnet torrent links at AcademicTorrents if you’d like. They are just a collection of url strings after all.

https://academictorrents.com/

Re:Pirate Face Rescues LLM Models from Deletion by amelius on Sunday September 20, 2026 @05:46PM (#49780430)
The "pirate" name ensures that no company will buy it out later ;)
Re:Pirate Face Rescues LLM Models from Deletion by Scaled on Sunday September 20, 2026 @01:58PM (#49778219)
This site could be useful also since there's been a recent trend of abliterated model providers demanding a hugging face account and email collection. I assume this is so the providers can spam people since there's not much other benefit. Hugging face had also been making it harder to sign up with disposable email addresses since they throw a weird error during sign up if they detect it. Anyway, I see a site like this being useful to sidestep all that data collection.
Re:Pirate Face Rescues LLM Models from Deletion by thih9 on Sunday September 20, 2026 @02:24PM (#49778483)
> The goal is permanence for open-source AI

My instinct is to correct this to “open weight”, because when I filter huggingface by open source[1], I get only one result.

Then again, this could be about long term goals so perhaps I’m wrong; I wouldn’t mind that.

[1]: https://huggingface.co/models?other=open-source-model&sort=t...

[dead]
Re:Pirate Face Rescues LLM Models from Deletion by bibimsz on Sunday September 20, 2026 @02:31PM (#49778549)
why downvote? it's literally the site's sign-up process to post this comment.
Re:Pirate Face Rescues LLM Models from Deletion by shevy-java on Sunday September 20, 2026 @02:31PM (#49778542)
I do not want AI to live forever though.
Re:Pirate Face Rescues LLM Models from Deletion by JonChesterfield on Sunday September 20, 2026 @03:00PM (#49778860)
This is really important. I am already tired of hoarding rclone copies of huggingface torrents and periodically checking them for bitrot. Pirateface is not a very helpful name for it though and it doesn't seem to have scripted torrent creation either.

Is hosting the same thing at 'academictorrents' actually a viable thing? In terms of peers from either send data to one another?

edit: looks like it can treat huggingface as a backstop for torrents that are otherwise not shared which is interesting, whole load of checksum nonsense I hand rolled disappear if bittorrent handles that. Except it doesn't work?

    Magnet soon No seeders yet - a torrent mints once a seeder packages this model.
So there's some per-torrent work to be done, but I don't know what that is, and I don't see how it can be based on files I have locally _and also_ be an exact match to files on huggingface. So I'm missing something here.
Re:Pirate Face Rescues LLM Models from Deletion by sharktheone on Sunday September 20, 2026 @03:13PM (#49778979)
I hope GPT-3.5 will be released at some point. Would make me really sad if that gets lost at some point
Re:Pirate Face Rescues LLM Models from Deletion by mitxela on Sunday September 20, 2026 @03:14PM (#49778991)
Why is the sign-up system so complicated? Why not just log into your HF account and be done? You're trying to force people to spam on X and HN so that their X and HN accounts get deleted?
Re:Pirate Face Rescues LLM Models from Deletion by forq on Sunday September 20, 2026 @05:32PM (#49780289)
I claimed the "forq" handle on Pirate Face.

Where Hugging Face AI models never die, and are immortalized as torrents.

Claim yours: https://pirateface.co/claim?ref=forq

Re:Pirate Face Rescues LLM Models from Deletion by itomato on Sunday September 20, 2026 @08:43PM (#49781710)
You can delete this now.
Re:Pirate Face Rescues LLM Models from Deletion by Proobel on Sunday September 20, 2026 @06:00PM (#49780527)
Why not use existing platforms? In any case, a resource like this is a step toward open AI.
Re:Pirate Face Rescues LLM Models from Deletion by ButlerianJihad on Sunday September 20, 2026 @06:23PM (#49780722)
Re:Pirate Face Rescues LLM Models from Deletion by protocolture on Sunday September 20, 2026 @07:06PM (#49781067)
waow

(based based based based based based based)

Re:Pirate Face Rescues LLM Models from Deletion by sakurei on Sunday September 20, 2026 @07:25PM (#49781187)
s
Re:Pirate Face Rescues LLM Models from Deletion by sakurei on Sunday September 20, 2026 @07:26PM (#49781190)
ss
Re:Pirate Face Rescues LLM Models from Deletion by Lukas4 on Sunday September 20, 2026 @07:27PM (#49781206)
I claimed the "lukas4" handle on Pirate Face.

Where Hugging Face AI models never die, and are immortalized as torrents.

Claim yours: https://pirateface.co/claim?ref=lukas4

Re:Pirate Face Rescues LLM Models from Deletion by kinti on Sunday September 20, 2026 @07:50PM (#49781376)
I claimed the "kinti" handle on Pirate Face.

Where Hugging Face AI models never die, and are immortalized as torrents.

Claim yours: https://pirateface.co/claim?ref=kinti

Re:Pirate Face Rescues LLM Models from Deletion by totetsu on Sunday September 20, 2026 @10:32PM (#49782414)
Is this a reaction to the idea that when HuggingFace comes into Nvidia owership, lots of models are going to be removed from the platform?
Re:Pirate Face Rescues LLM Models from Deletion by irraodess on Sunday September 20, 2026 @11:24PM (#49782709)
I claimed the "irrao" handle on Pirate Face.

Where Hugging Face AI models never die, and are immortalized as torrents.

Claim yours: https://pirateface.co/claim?ref=irrao

Re:Pirate Face Rescues LLM Models from Deletion by kittikitti on Sunday September 20, 2026 @11:54PM (#49782875)
Making it to the finish line to seed a model is satisfying.
Re:Pirate Face Rescues LLM Models from Deletion by chadgpt7 on Monday September 21, 2026 @03:09AM (#49783985)
I've been known to seed a model or two in my day. Still married to one!
Re:Pirate Face Rescues LLM Models from Deletion by velmu on Monday September 21, 2026 @12:01AM (#49782914)
I claimed the "janit" handle on Pirate Face.

Where Hugging Face AI models never die, and are immortalized as torrents.

Claim yours: https://pirateface.co/claim?ref=janit

Re:Pirate Face Rescues LLM Models from Deletion by realityloop on Monday September 21, 2026 @12:14AM (#49782979)
I claimed the "itsvrk" handle on Pirate Face.

Where Hugging Face AI models never die, and are immortalized as torrents.

Claim yours: https://pirateface.co/claim?ref=itsvrk

Re:Pirate Face Rescues LLM Models from Deletion by ovia-inc on Monday September 21, 2026 @12:49AM (#49783176)
ovia-inc