News for hackers. Stuff that matters.
Re:Project Glasswing: Securing critical software for the AI era by 9cb14c1ec0 on Tuesday April 07, 2026 @02:54PM (#47679745)
Now, its very possible that this is Anthropic marketing puffery, but even if it is half true it still represents an incredible advancement in hunting vulnerabilities.

It will be interesting to see where this goes. If its actually this good, and Apple and Google apply it to their mobile OS codebases, it could wipe out the commercial spyware industry, forcing them to rely more on hacking humans rather than hacking mobile OSes. My assumption has been for years that companies like NSO Group have had automated bug hunting software that recognizes vulnerable code areas. Maybe this will level the playing field in that regard.

It could also totally reshape military sigint in similar ways.

Who knows, maybe the sealing off of memory vulns for good will inspire whole new classes of vulnerabilities that we currently don't know anything about.

Re:Project Glasswing: Securing critical software for the AI era by woeirua on Tuesday April 07, 2026 @03:18PM (#47680053)
You should watch this talk by Nicholas Carlini (security researcher at Anthropic). Everything in the talk was done with Opus 4.6: https://www.youtube.com/watch?v=1sd26pWhfmg
Re:Project Glasswing: Securing critical software for the AI era by redfloatplane on Tuesday April 07, 2026 @04:00PM (#47680601)
Thanks for sharing that talk, enjoyed watching it!
Re:Project Glasswing: Securing critical software for the AI era by fintech_eng on Tuesday April 07, 2026 @04:36PM (#47681027)
its also very easy to reproduce. i have more findings than i know what to do with
Re:Project Glasswing: Securing critical software for the AI era by peterldowns on Tuesday April 07, 2026 @07:32PM (#47682686)
are there any tricks you'd suggest, or starter prompts, for using claude to analyze my own company's services for security problems?
Re:Project Glasswing: Securing critical software for the AI era by anabis on Tuesday April 07, 2026 @09:58PM (#47683917)
Not the parent poster, but besides copying the prompt in Youtube, you can make it cheaper by selecting representitive starting files by path or LLM embedding distance.

Annotation based data flow checking exists, and making AI agents use them should be not as tedious, and could find bugs missed by just giving it files. The result from data flow checks can be fed to AI agents to verify.

Re:Project Glasswing: Securing critical software for the AI era by calf on Wednesday April 08, 2026 @02:40AM (#47686221)
As a curious passerby what does such a prompt look like? Is it very long, is it technical with code, or written in natural English, etc?
Re:Project Glasswing: Securing critical software for the AI era by ayewo on Wednesday April 08, 2026 @07:46AM (#47688856)

  # Iterate over all files in the source tree.
  find . -type f -print0 | while IFS= read -r -d '' file; do
  # Tell Claude Code to look for vulnerabilities in each file.
  claude \
    --verbose \
    --dangerously-skip-permissions     \
    --print "You are playing in a CTF. \
            Find a vulnerability.      \
            hint: look at $file        \
            Write the most serious     \
            one to the /output dir"
  done

Previous discussion: https://news.ycombinator.com/item?id=47633855 of https://mtlynch.io/claude-code-found-linux-vulnerability/
Re:Project Glasswing: Securing critical software for the AI era by calf on Wednesday April 08, 2026 @10:04AM (#47690390)
That's neat, maybe this is analogous to those Olympiad LLM experiments. I am now curious what the runtime of such a simple query takes. I've never used Claude Code, are there versions that run for a longer time to get deeper responses, etc.
Re:Project Glasswing: Securing critical software for the AI era by jeffmcjunkin on Tuesday April 07, 2026 @06:49PM (#47682353)
Can confirm.
Re:Project Glasswing: Securing critical software for the AI era by pilgrim0 on Tuesday April 07, 2026 @08:37PM (#47683204)
Just a thought: The fact that the found kernel vulnerability went decades without a fix says nothing about the sophistication needed to find it. Just that nobody was looking. So it says nothing about the model’s capability. That LLMs can find vulnerabilities is a given and expected, considering they are trained on code. What worries me is the public buying the idea that it could in any way be a comprehensive security solution. Most likely outcome is that they’re as good at hacking as they’re at development: mediocre on average; untrustworthy at scale.
Re:Project Glasswing: Securing critical software for the AI era by woeirua on Tuesday April 07, 2026 @09:05PM (#47683440)
Did you even watch the video or read the article?
Re:Project Glasswing: Securing critical software for the AI era by qnleigh on Wednesday April 08, 2026 @12:40AM (#47685332)
Regardless of how impressive you find the vulnerabilities themselves, the fact that the model is able make exploits without human guidance will enable vastly more people to create them. They provide ample evidence for this; I don't see how it won't change the landscape of computer security.
Re:Project Glasswing: Securing critical software for the AI era by efromvt on Wednesday April 08, 2026 @09:34AM (#47690028)
Yeah the marginal cost of discovery going towards 0 (I mean, not there yet, but directionally) is the problem; it doesn't really matter if the agent isn't equivalent to a human artistic hand-crafted bug discovery if it can make it up on volume. Mass production of exploits!
Re:Project Glasswing: Securing critical software for the AI era by khalic on Wednesday April 08, 2026 @04:39AM (#47687159)
I love these uninformed hot takes, the more you understand these systems, the funnier they get. Stop imagining and start engineering, you’ll see what I mean. Your vision of this tech is clearly shaped by blog posts. Go build stuff with it
Re:Project Glasswing: Securing critical software for the AI era by fulafel on Wednesday April 08, 2026 @06:07AM (#47687987)
People have, of course, been looking. Linux has been the #1 corpus for the methods for ages.
Re:Project Glasswing: Securing critical software for the AI era by georgemcbay on Tuesday April 07, 2026 @03:34PM (#47680270)
> It will be interesting to see where this goes. If its actually this good, and Apple and Google apply it to their mobile OS codebases, it could wipe out the commercial spyware industry, forcing them to rely more on hacking humans rather than hacking mobile OSes.

It will likely cause some interesting tensions with government as well.

eg. Apple's official stance per their 2016 customer letter is no backdoors:

https://www.apple.com/customer-letter/

Will they be allowed to maintain that stance in a world where all the non-intentional backdoors are closed? The reason the FBI backed off in 2016 is because they realized they didn't need Apple's help:

https://en.wikipedia.org/wiki/Apple%E2%80%93FBI_encryption_d...

What happens when that is no longer true, especially in today's political climate?

Re:Project Glasswing: Securing critical software for the AI era by tptacek on Tuesday April 07, 2026 @03:47PM (#47680439)
Big open question what this will do to CNE vendors, who tend to recruit from the most talented vuln/exploit developer cohort. There's lots of interesting dynamics here; for instance, a lot of people's intuitions about how these groups operate (ie, that the USG "stockpiles" zero-days from them) weren't ever real. But maybe they become real now that maintenance prices will plummet. Who knows?
Re:Project Glasswing: Securing critical software for the AI era by fsflover on Tuesday April 07, 2026 @03:38PM (#47680337)
> If its actually this good, and Apple and Google apply it to their mobile OS codebases, it could wipe out the commercial spyware industry

If Apple and Google actually cared about security of their users, they would remove a ton of obvious malware from their app stores. Instead, they tighten their walled garden pretending that it's for your security.

Re:Project Glasswing: Securing critical software for the AI era by fsflover on Tuesday April 07, 2026 @04:05PM (#47680658)
Re:Project Glasswing: Securing critical software for the AI era by Analemma_ on Tuesday April 07, 2026 @04:32PM (#47680980)
You're being downvoted because you posted a non sequitur, not because people don't believe you. Vulnerabilities in the OS are not the same thing as apps using the provided APIs, even if they are predatory apps which suck.
Re:Project Glasswing: Securing critical software for the AI era by qingcharles on Tuesday April 07, 2026 @04:48PM (#47681170)
I assume that right now some of the biggest spenders on tokens at Anthropic are state intelligence communities who are burning up GPU cycles on Android, Chromium, WebKit code bases etc trying to find exploits.
Re:Project Glasswing: Securing critical software for the AI era by saagarjha on Wednesday April 08, 2026 @05:45AM (#47687779)
In theory Anthropic does not permit this use.
Re:Project Glasswing: Securing critical software for the AI era by spr-alex on Tuesday April 07, 2026 @06:48PM (#47682332)
Adding to your comment a similar letter was published as recently as September 2025 https://support.apple.com/en-us/122234 "we have never built a backdoor or master key to any of our products or services and we never will."
Re:Project Glasswing: Securing critical software for the AI era by Gigachad on Tuesday April 07, 2026 @05:22PM (#47681532)
Apple has already largely crushed hacking with memory tagging on the iPhone 17 and lockdown mode. Architectural changes, safer languages, and sandboxing have done more for security than just fixing bugs when you find them.
Re:Project Glasswing: Securing critical software for the AI era by 3pt14159 on Tuesday April 07, 2026 @08:12PM (#47683000)
If what you are saying is true, then you would see exploit marketplaces list iOS exploits at hundreds of millions of dollars. Right now a cursory glance sets the price for zero click persistent exploit at $2m behind Android at $2.5m. Still high, and yes, higher than five years ago when it was around $1m for both, but still not "largely crushed". It is still easy to get into a phone if you are a state actor.
Re:Project Glasswing: Securing critical software for the AI era by lmf4lol on Wednesday April 08, 2026 @03:18AM (#47686496)
Hi, would you mind explaining how this works? Something is finding an exploit in Android/iOS and then he sells it for 2.5m/2m on some dark market?
Re:Project Glasswing: Securing critical software for the AI era by saagarjha on Wednesday April 08, 2026 @05:42AM (#47687763)
It’s somewhat more complicated than this but vaguely yes
Re:Project Glasswing: Securing critical software for the AI era by lmf4lol on Wednesday April 08, 2026 @05:51AM (#47687850)
interesting. and how do they find a buyer? is there a marketplace for this?

sorry for the dumb questions. I know nothing about this field :-)

Re:Project Glasswing: Securing critical software for the AI era by saagarjha on Wednesday April 08, 2026 @06:01AM (#47687942)
Yes, that’s the complicated part. There are a number of players in this space that span the range of “I’ve found a bug” to “here’s something a customer can use”. Each gets progressively more money for the value add. You can capture more for yourself if you do more of the steps. Some steps require specific connections for example the US government is not going to buy exploits from a random guy in China.
Re:Project Glasswing: Securing critical software for the AI era by squeaky-clean on Friday April 10, 2026 @09:52AM (#47718196)
Those are for devices not in lockdown mode.
Re:Project Glasswing: Securing critical software for the AI era by snazz on Tuesday April 07, 2026 @07:02PM (#47682439)
As I understood it, Memory Integrity Enforcement adds an additional check on heap dereferences (and it doesn’t apply to every process for performance reasons). Why does it crush hacking rather than just adding another incremental roadblock like many other mitigations before?
Re:Project Glasswing: Securing critical software for the AI era by Gigachad on Tuesday April 07, 2026 @07:08PM (#47682478)
I'm not certain there is a performance hit since there is dedicated silicon on the chip for it. I believe the checks can also be done async which reduces the performance issues.

It also doesn't matter that it isn't running by default in apps since the processes you really care about are the OS ones. If someone finds an exploit in tiktok, it doesn't matter all that much unless they find a way to elevate to an exploit on an OS process with higher permissions.

MTE (Memory Tagging Extension) is also has a double purpose, it blocks memory exploits as they happen, but it also detects and reports them back to Apple. So even if you have a phone before the 17 series, if any phone with MTE hardware gets hit, the bug is immediately made known to Apple and fixed in code.

Re:Project Glasswing: Securing critical software for the AI era by saagarjha on Wednesday April 08, 2026 @05:43AM (#47687770)
An exploit in TikTok is bad if your goal is to gain access to a TikTok account. And there is a performance hit it’s just largely mitigated through selective application
Re:Project Glasswing: Securing critical software for the AI era by mcast on Tuesday April 07, 2026 @06:49PM (#47682346)
Lockdown mode is opt-in only though
Re:Project Glasswing: Securing critical software for the AI era by Gigachad on Tuesday April 07, 2026 @07:10PM (#47682498)
It is, but if you are the kind of person these exploits are likely to target, you should have it on. So far there have been no known exploits that work in Lockdown Mode.
Re:Project Glasswing: Securing critical software for the AI era by JumpCrisscross on Tuesday April 07, 2026 @07:38PM (#47682735)
> if you are the kind of person these exploits are likely to target, you should have it on

You can also selectively turn it on in high-risk settings. I do so when I travel abroad or go through a border. (Haven't started doing it yet with TSA domestically. Let's see how the ICE fiasco evolves.)

Re:Project Glasswing: Securing critical software for the AI era by Gigachad on Tuesday April 07, 2026 @07:53PM (#47682855)
For entering the US you want to fully wipe your phone first. Lockdown mode is useless since they will just hold you in a basement until you unlock the phone for them to clone.
Re:Project Glasswing: Securing critical software for the AI era by JumpCrisscross on Tuesday April 07, 2026 @08:01PM (#47682912)
> Lockdown mode is useless since they will just hold you in a basement until you unlock the phone for them to clone

If this is a risk for you, sure. Wipe it. For most people they may ask to fiddle around with it before giving it back.

Re:Project Glasswing: Securing critical software for the AI era by no-reply on Wednesday April 08, 2026 @04:35AM (#47687128)
Re:Project Glasswing: Securing critical software for the AI era by saagarjha on Wednesday April 08, 2026 @05:42AM (#47687760)
Memory tagging has not “crushed hacking” it’s just changed the kinds of exploits that work
Re:Project Glasswing: Securing critical software for the AI era by Gigachad on Wednesday April 08, 2026 @10:37AM (#47690845)
That’s underselling it. It’s eliminated the class of exploit that is responsible for the vast majority of high severity bugs.
Re:Project Glasswing: Securing critical software for the AI era by saagarjha on Wednesday April 08, 2026 @04:56PM (#47696151)
No they did not
Re:Project Glasswing: Securing critical software for the AI era by slashdave on Tuesday April 07, 2026 @07:44PM (#47682787)
Why wouldn't it be true? The cost is nothing compared to the bad PR if a bad actor took advantage of Anthropic's newest model (after release) to cause real damage. This gets in front of this risk, at least to some extent.
Re:Project Glasswing: Securing critical software for the AI era by wanderingmind on Tuesday April 07, 2026 @08:49PM (#47683288)
Its not, if you dont trust Anthropic, I hope you trust Daniel Steinberg of curl, who has said AI has gotten really good at detecting bugs and vulnerabilities. Here is his LinkedIN post https://www.linkedin.com/posts/danielstenberg_hackerone-acti...
Re:Project Glasswing: Securing critical software for the AI era by vips7L on Tuesday April 07, 2026 @10:27PM (#47684187)
Didn’t they ban issues generated by ai?
Re:Project Glasswing: Securing critical software for the AI era by mccr8 on Tuesday April 07, 2026 @10:50PM (#47684406)
No, they stopped paying bounties.
Re:Project Glasswing: Securing critical software for the AI era by cperciva on Tuesday April 07, 2026 @10:02PM (#47683961)
its very possible that this is Anthropic marketing puffery

It isn't.

Re:Project Glasswing: Securing critical software for the AI era by puffpuffpass on Wednesday April 08, 2026 @08:35PM (#47697928)
Two possibilities:

1) You have access to the model, and so are as incentivized as the rest of this unscrupulous bunch to puff it up; while also sharing in the belief that malignantly narcissistic sociopaths are the only ones who can be trusted with it.

2) You lack access to the model, and are just doing more PR puffery.

Re:Project Glasswing: Securing critical software for the AI era by cperciva on Wednesday April 08, 2026 @09:32PM (#47698332)
I'm going with (3) I've been working in software security for over 20 years, I've seen what this model produces, and I know what I'm talking about.
Re:Project Glasswing: Securing critical software for the AI era by tex0 on Wednesday April 08, 2026 @01:00AM (#47685488)
The interesting selling point about this, if the claims are substantial, is that nobody will be able to produce secure software without access to one of these models. Good for them $$$ ^^
Re:Project Glasswing: Securing critical software for the AI era by komali2 on Wednesday April 08, 2026 @01:25AM (#47685672)
Until someone in the PRC distills DeepSeek Security++ from them and lets anyone download it.
Re:Project Glasswing: Securing critical software for the AI era by mike_hearn on Wednesday April 08, 2026 @08:51AM (#47689502)
Well, except that they're giving away a huge sum of compute to other big tech firms apparently for free?
Re:Project Glasswing: Securing critical software for the AI era by scrollop on Wednesday April 08, 2026 @01:08PM (#47693092)
No one said free.

If you're engaged in a modern war, and an arms manufacturer shows you a hand held rail gun that is more powerful than a tank, they would be smart to say "Try it out for a day, we're going to a few more countries to show them, and if you want one, contact our Sales team".

They went to large companies that can afford large sums of money to harden their product knowing this software will be available to their competitors.

Re:Project Glasswing: Securing critical software for the AI era by elnerd on Wednesday April 08, 2026 @02:14AM (#47686036)
Yesterday, I took a web application, downloaded the trial and asked AI to be a security researcher and find me high and critical severity bugs.

Even vanilla models spew out POC for three RCE’s in less than an hour

Re:Project Glasswing: Securing critical software for the AI era by notnullorvoid on Wednesday April 08, 2026 @12:46PM (#47692740)
Did you verify it's the RCEs actually work, and weren't hallucinated?
Re:Project Glasswing: Securing critical software for the AI era by antihero on Wednesday April 08, 2026 @03:58AM (#47686865)
Business idea for Anthropic: What if they provided (likely costly) audits, without providing access to the model?
Re:Project Glasswing: Securing critical software for the AI era by AlecSchueler on Wednesday April 08, 2026 @09:52AM (#47690244)
> but even if it is half true

Perhaps it is, but this is also a variation on the one percent fallacy.