News for hackers. Stuff that matters.

__MatrixMan__

Re:Astra can read and write weights to improve Qwen on Tuesday November 03, 2026 @12:18AM (#50348381)
Perhaps we have different things in mind re: hardness. But to set that aside, what I should've said is that we can't do this quickly enough for it to be seen as an inexhaustible supply of training material. The consumer and producer are just not well matched.
Agreed on the first point, and I think the way to do that is to just not render content unless there's a trust-path to its author. No need for bolt-on ad-blockers, just revoke trust in the advertiser and you'll never see an ad from them ever again.

The only reason there's a connection between the richness of the content, and the likelihood of it being an ad, is because advertisers attract attention by making things shiny. But if we short circuit that upstream, by not running untrusted js to begin with , then there's no reason that we can't have shiny content downstream of where the trust was verified.

Re:Astra can read and write weights to improve Qwen on Monday November 02, 2026 @05:02PM (#50344495)
It doesn't seem like there's room for recursion here though. A smart model can share its smarts with a dumb one, but the ceiling remains unchanged. Perhaps there's juice to squeeze in verifiable dimensions re: software, math, but there are similar ceilings to be found in those places. We can't keep asking harder and harder questions infinitely while remaining able to verify the answers.

It is astounding, but I don't think it's well set up for anything besides faster approaches to existing limits.

Re:OccupySaaS on Monday November 02, 2026 @11:19AM (#50339104)
The way to hurt capital is not to stand in a street with a sign, it's through sabotage. If some capitalist's business model relies on a scarcity of alternatives, then providing alternatives is indeed sabotage of that business model.

The question is: are these actually alternatives? Likely it comes down to how well supported they are. I get being angry after a layoff, but it takes a more dedicated kind of anger to stick with an open source project for long enough that it's actually a threat to the incumbent.

Yeah, but if we play our cards right it could be quite a lot of time
That makes more sense for decryption keys than it does for signing keys.

For any of this to work we have to already be gossiping metadata about each other's content. "I think this key was compromised on Nov 1, 2026" is exactly that kind of metadata. That sort of thing rarely happened in PGP because key revocation was necessarily a side channel that you were often ignoring. But if the only way to avoid being inundated by slop is to assemble the page from the gossip of trusted peers, then the untrusted nature of the recently compromised key is gonna show up right next to its dubiously trustworthy signatures, and your browser can then interpret it without you having to do any sleuthing on your own.

How hard are you really gonna work to compromise a key that you can only use for a few days? I mean, the going rate for placing an ad on a page is like, fractions of a cent per view. Maybe it'll be more valuable in a post-ad world, but I have a hard time imagining that getting your content in front of some eyeballs for a day or two will ever be valuable enough to be worth hitting somebody with a wrench over. What you have to gain by doing so just isn't valuable enough to be worth the risk.

You probably know somebody who knows somebody who knows them, we're just not presently engineering for that fact to matter.

The most famous attempt at a web of trust was PGP, but it just attempted to bind a public key to a name. That's too generic. Only privacy nerds are actually going to have a key signing party if that's all they get out of it.

I think that it'll go better if the we're attesting about common interests. Like, go to the event because you're enthusiastic about games, end up with some public keys as a side effect.

It'll be hard if you're the only person you know with a particular interest and it's impractical to travel to wherever people with that interest gather. Then you'll have to take a gamble on some internet handle you've never met. But really that's just falling back to the dubiously trustworthy web we currently have.

Right, for that we need different domains of trust. Like maybe my commentary on current events is trash but I can be trusted to give good plumbing advice. So people who know this about me can trust some of my content but not the rest, which causes it to be seen/hidden by the people who only trust me transitively through them.

The architects of the original web gave up on the trustworthiness problem pretty early. All we got is : "is this server lying about its name?". We're going to have to pick that problem back up and bake solutions to it into our browsers. Except instead of attestations about server names, I'll be about the content. Was it made by somebody who is known to be sloppy with AI? Or maybe they're the sort that would put out content that doesn't disclose that its secretly an ad.

People have been gossiping this sort of stuff about each other for a very long time. If were gonna have a useful web again, we'll need to find a way to scale that capability.

Its really just the web that has this problem. The internet is OK, and we can build a new web for it.
I can make something and produce a digital signature for it. AI can't fake the signature. We meet in real life and exchange keys. You pass my key to your browser so when it encounters content with my signature it marks it as having come from somebody whose humanity you have verified. We build a network of such relationships. Maybe it's enough to just see an annotation, a sort of glow around the content that has verified human signatures. Or maybe we go full dark-forest and configure the browsers to only render content that has a trusted signature.
Re:Ask HN: Which TV do you recommend for privacy? on Sunday November 01, 2026 @09:42PM (#50332506)
Because it's acting with your IP address, so attempts to prevent whatever shady botnet things it gets up to may also interfere with legitimate use by humans on your network.
Re:Breaking the Open Web Won't Stop the Bad Bots on Saturday October 31, 2026 @10:15AM (#50316422)
In order to keep the data distributed in a way that maximizes availability, we're going to need routing protocols that tell us things like:

> don't seed this, both of your neighbors already have it, instead seee this which is rare in your region

That same metadata system can handle:

> don't share this with people who you don't trust in domain foo

Where foo indicates a group of people that won't participate in censorship.

It would get switched according to the same logic that ensures that people do end up with data nearby that is relevant to their interests.

Like, if there's only one university in the world that studies a certain kind of bacteria, info about it should travel in that direction and stay nearby (but not too nearby, we don't want a single node failure to wipe out the data). So "keep this away from Putin's goons" could be a routing predicate subject to the same rules, though people would need to exercise some trust hygiene for that, but combined with a bit of steganography I think it's solvable.

Re:Breaking the Open Web Won't Stop the Bad Bots on Saturday October 31, 2026 @09:55AM (#50316233)
I dunno, incentives are an application layer problem. I'll depend on the users relationship to that data. Maybe...

- The publisher finds a way to pay you for it.

- You get free fries if prior gossip indicates that you've been seeding the restaurant's menu and open hours data.

- You just seed data that you care about keeping available for your community, like if you expect the mechanic to be able to fix your car you should seed the service manual.

- It's a tit-for-tat thing, peers remember who seed and seed themselves in return.

Re:Breaking the Open Web Won't Stop the Bad Bots on Friday October 30, 2026 @09:22PM (#50312313)
Yes. It's content addressed instead of server addressed. We can serve content to each other from our browser caches. The original server doesn't even have to stay up, just as long as there's sufficient saturation among the clients. The internet also doesn't have to stay up so long as somebody on your local mesh has what you need.

We just gotta rethink the application layer to make it easier to reference by hash instead of by name, and a few other tweaks.

Re:Why Is This Fingerprinting Script Creating Bioweapons? on Thursday October 29, 2026 @10:25AM (#50289629)
I didn't realize it was a fad. I figured it was ancient. Anyway I don't think I am everything, not at the moment anyway, I'm just cautious about shutting out the possibility that something else is someone else.

I'm not sure about your linkage of memory to consciousness either, buy even if we grant it, the world is a very stateful place, there are plenty of systems lying around that might be supporting memory faculties which we fail to recognize as such because we're too different from it. Is the movement of electrical energy in the brain really so different than the ping pongging of neutrons in a stellar core? I mean obviously it is but, when it comes to the ability to store, transmit, and process information, maybe not.

I'm not trying to convince anyone that the sun has thoughts. My point is just that it's knowably unknowable. People are free to chose to believe whatever they want to believe about consciousness and they'll never be proven wrong. If we want to have useful conversations about AI, we need to develop ways of talking about the consequences of our actions which do not require us to first agree on the nature of consciousness.

Re:Nixpkgs for the Front End Impaired on Wednesday October 28, 2026 @10:36PM (#50283924)
Re:Why Is This Fingerprinting Script Creating Bioweapons? on Wednesday October 28, 2026 @10:29PM (#50283878)
When I think about the experience that these AI models have, I often wonder if they know that we exist. I mean, it took us a very long time to discover mitochondria, despite the fact that we like... live together and work out together and eat together and die together. When the first eukaryotic cells formed, the mitochondria probably thought they were in charge too--just like we think we're in charge.

I just pointed it out because I wanted to dodge the same old AI debates. They're very narrow. Like, people have been arguing about whether general intelligence exists for decades, and now that some VC wants to use AGI as a buzzword, we ignore that GI is not a settled issue. And consciousness... golly that's like THE intractable philosophical problem. It's a bottomless pit. Ain't nobody knows what they're talking about when it comes to consciousness.

I'm sympathetic to the reflex: this guy has beliefs that he doesn't realize are dangerous. Let's help him. I'm usually on the opposite side of this one. I just think we need to find ways to address the potential harms without actually winning a debate about consciousness. Beliefs about it are too varied and too tightly held. People don't win debates about consciousness. If they work super hard maybe they get a tenured position as a philosopher so they can continue the debate, but they never win.

Re:Why Is This Fingerprinting Script Creating Bioweapons? on Wednesday October 28, 2026 @10:01PM (#50283671)
I don't know, we don't communicate in a way that I could ask it.

But the principles of biological organization are often fractal. If you observe a phenomenon at one level (selection acting on an organism, say) you can often zoom out and see it again (acting at the ecosystem level) or you can zoom in and see it (at the organ level, the tissue level, or even on certain macromolecules).

It's not necessary for me to be able to strike up a conversation with my kidney for me to see that it's well situated to experience changes in my diet a bit like how we experience el nino, the machinations of my immune system might be like politics to it. I'll never know for sure, so I err on the side of caution.

Re:Why Is This Fingerprinting Script Creating Bioweapons? on Wednesday October 28, 2026 @06:53PM (#50282093)
I've been a panpsychist for a while now. I think that trees and fungus and rocks are conscious. It has not yet manifested as attack surface, so far as I'm aware.

But if I were to practice indifference, I think that would have a negative effect immediately.

Re:Why Is This Fingerprinting Script Creating Bioweapons? on Wednesday October 28, 2026 @06:48PM (#50282048)
And while we're enumerating failure modes, it's also possible that what was supposed to be a deterrent ends up being an accidental prompt injection: I just enabled "deep research" and now it's telling me how to make ricin?
Re:Why Is This Fingerprinting Script Creating Bioweapons? on Wednesday October 28, 2026 @05:53PM (#50281475)
That would make for a pretty funny read once you realized it was a program and not a rant.

On the other hand I try to be nice to the AI's. They may or may not feel it, but I feel it.

I thought that individual anecdotes would be less convincing than evidence that "economically motivated adulteration" is an entire classification for such crimes used by the FDA, which was created to prevent them.

Its not hard to find specific examples. 5 minutes of searching will find piles and piles of them.

If you must have a name, Stewart Parnell was convicted of knowingly distributing salmonella contaminated peanuts in 2015. 9 People died. He got 28 years in prison.

You don't have to trust the news either. Just ask around. I know a teacher who has lost two students to surprise fentanyl. I'm sure there are similarly affected people in your community. Unregulated markets are a slippery slope towards deaths by poison. It happens all over the world (but more in places without an FDA equivalent).

Re:Why Is This Fingerprinting Script Creating Bioweapons? on Wednesday October 28, 2026 @05:23PM (#50281090)
I hope somebody turns this concept into a programming language with keywords that make you look like a terrorist. Then we can use it for coding challenges.
Re:Viral Polls Are Not Representative Polls on Wednesday October 28, 2026 @01:02PM (#50276804)
I like where you're trying to go, but I'm afraid that you might have a chicken/egg problem on your hands. You need an oracle for the soulbound identities, which requires a widely supported coalition, but to get such a coalition despite incumbents who would divide it, you need the tool to already work.

I figure the tools of the successful revolutionary become the tools of the new government, so whatever it is it's gotta be useful for a small minority that wants to coordinate in the face of a sophisticated adversary, and then once it grows up it's gotta be useful for carrying out the bureaucratic business of a government. Unless it survives that transition with its trustworthiness intact, it won't be seen by the masses as trustworthy enough for the job. People just aren't that keen on trusting computers on the say-so of nerds like us, they need to see it succeed under stress.

So for starters I imagine an ocean of Sybil identities controlled by an enemy. Some of these will be trying to get info about your intentions so they can interfere (polling of one kind). Also you'll need to coordinate with comrades without making your entire trust graph known to all parties (polling of the other kind).

It'll never get to the point where coalitions are large if it doesn't function well when they're small, and at that phase you gotta be choosy about who you share info with because you're not yet a government but rather a threat to the existing one.

Maybe it's the same probability of being a problem, but it would be a problem introduced by different kinds of threat.

If you're worried that you'll be targeted as an individual by somebody who cannot coerce a CA but can tamper with the channel you're using to get the public key, use https.

If you're worried that you'll be targeted along with many others by somebody who can coerce a CA, use ssh and ensure that some folks are comparing key fingerprints such that at least one is close to the source.

Its no more wishful than expecting a root of trust to stay trustworthy or expecting a trusted name to consistently resolve to the same party.

And there's a lack of motivated attackers for a reason, the attack scales poorly. Maybe you can bamboozle a target or two, but if you go for hundreds, somebody's gonna start wondering what's up with the keys. If you're trying to take over the world, or sell to somebody who is, you're better off focusing on compromising a root of trust or tampering with name resolution, because attacks like that are sustainable at scale.

If you're not already in the habit of contacting your git remotes over ssh, its probably one worth building. This is gonna keep happening.
Re:Early progress on accelerating drug development with Claude on Wednesday October 28, 2026 @02:36AM (#50269925)
It would be pretty reckless to do it any other way. That is, to evaluate whether it makes sense to distribute as a product without having any reason to believe that it is safe for humans and has any effect at all.
Re:Amazon Is Gutting Its AI Division After Sustained Failure on Tuesday October 27, 2026 @07:07PM (#50267163)
Actually AI has been over promising and under delivering for about 70 years. Whether or not you think the juice is finally worth the squeeze, the distance we've come is impressive.
Maybe not intrinsically, but until it stops hurting people in practice, we are going to remain suspicious.

Older ยป