News for hackers. Stuff that matters.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by nsingh2 on Thursday April 23, 2026 @05:51PM (#47882589)
These plots are terrible. Why is categorical data connected across categories with lines? Why not just use bar plots?

Like in the "Web Vulns in OSS" plot, white box data for Opus 4.7 is not available, but the absurd linear interpolation across categories implies it should be near 60.

Re:GPT-5.5: Mythos-Like Hacking, Open to All by scottyah on Thursday April 23, 2026 @06:14PM (#47882857)
It's just an ad thinly disguised as useful data.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by wmf on Thursday April 23, 2026 @06:31PM (#47883037)
I think the x axis is meant to be time but they screwed it up.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by strange_quark on Thursday April 23, 2026 @06:15PM (#47882866)
Wasn't it already confirmed that small open-weight models were able to detect most of the same headline vulns as mythos? How is this any different?
Re:GPT-5.5: Mythos-Like Hacking, Open to All by stanfordkid on Thursday April 23, 2026 @06:40PM (#47883145)
No, they are able to detect errors when pointed at them but they have a lot of false positives... making them functionally useless for a large unknown codebase. They also can't build and run an exploit post-identification. Mythos can find vulnerabilities (purportedly) and actually validate them by building and running exploits. This makes it functional and usable for hacking.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by dlahoda on Thursday April 23, 2026 @09:54PM (#47884594)
i casually asked gemini and codex 200usd subs to find and verify bugs for weeks. it did wrote tests, injected mutations, verified fixes. just promts.

also i had to proxy remote mainnet with localhost to force them to do penetration and dos testing.

mythos is nothing new.

Re:GPT-5.5: Mythos-Like Hacking, Open to All by adrian_b on Friday April 24, 2026 @07:28AM (#47888716)
The only significant difference between Mythos and the older open-weights models was that Mythos found all the bugs alone, while with the older models you had to run many of them in order to find all bugs, because each model found only a part of the bugs.

For the open weights models, we know the exact prompts that have been used to find the bugs. While the prompts had to be rather specific, a good bug-finding harness should be able to generate such prompts automatically, i.e. by running repeatedly a model while requesting to find various classes of bugs.

For Mythos, we do not know what prompts have been used, but Anthropic has admitted that the process was nothing like asking "find the bugs in this project". They have also run Mythos many times on each source file, starting with more generic prompts in order to identify whether a source file is likely to have bugs, and then following with more and more specific prompts, until eventually it became likely that a certain kind of bug exists, when Mythos was run one last time with a prompt that required the confirmation that the bug exists and the possible generation of an exploit or patch.

So Mythos must also be pointed to an error. Using it naively will not provide any results like those reported.

There is no doubt that both Mythos and GPT 5.5 are superior to older models, because you can use a single model and hope to have an adequate bug coverage. But the difference between them and older models has been exaggerated. If you run older models on your own hardware, you can afford to run many models many times on each file. A serious bug searching with Mythos or GPT 5.5 is likely to be very expensive, while likely to provide the same results in most cases.

Re:GPT-5.5: Mythos-Like Hacking, Open to All by 11217mackem on Friday April 24, 2026 @07:46PM (#47897177)
Have you used Mythos?
Re:GPT-5.5: Mythos-Like Hacking, Open to All by nardons on Thursday April 23, 2026 @06:38PM (#47883114)
Do you have a source for this? Not doubting it, but I would like to have something concrete the next time the Mythos horse manure is cited.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by skirmish on Thursday April 23, 2026 @07:59PM (#47883813)
Re:GPT-5.5: Mythos-Like Hacking, Open to All by WalterGR on Friday April 24, 2026 @02:03AM (#47886176)
Discussion:

https://news.ycombinator.com/item?id=47732020

“Small models also found the vulnerabilities that Mythos found” (aisle.com)

1,283 points | 12 days ago | 360 comments

Re:GPT-5.5: Mythos-Like Hacking, Open to All by mertcikla on Thursday April 23, 2026 @06:34PM (#47883082)
why does this read like an openai ad?
Re:GPT-5.5: Mythos-Like Hacking, Open to All by kibibu on Thursday April 23, 2026 @09:55PM (#47884595)
> GPT-5.5 doesn’t just improve — it pulls away

I think it's also self-aggrandizing.

Re:GPT-5.5: Mythos-Like Hacking, Open to All by WhiteDawn on Thursday April 23, 2026 @07:18PM (#47883498)
First you need to get through the safety net. I’ve had many productive gpt5.4 sessions hit a roadblock of “ethicality” and pollute the context with multiple rounds of trying to convince it to continue
Re:GPT-5.5: Mythos-Like Hacking, Open to All by JellyYelly on Thursday April 23, 2026 @08:17PM (#47883953)
They say its mythos like, without actually comparing it to Mythos (fair enough, it's not public) but the bar for a model to be mythos-like has to be that you can produce as many novel and high severity security vulns outlined in the Mythos redteam blog. I haven't seen any other lab produce a report like that yet. The proof is in the pudding.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by cassianoleal on Friday April 24, 2026 @04:05AM (#47887161)
> The proof is in the pudding.

Funny you say that, when the Mythos team have produced no proof either.

Re:GPT-5.5: Mythos-Like Hacking, Open to All by maplethorpe on Friday April 24, 2026 @04:14AM (#47887223)
I believe they've stated that it would be too dangerous to release.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by satvikpendem on Friday April 24, 2026 @09:47AM (#47890257)
Just like OpenAI said GPT 2 was too dangerous to release?

There was just an article on this phenomenon today: https://news.ycombinator.com/item?id=47890235

Re:GPT-5.5: Mythos-Like Hacking, Open to All by maplethorpe on Friday April 24, 2026 @12:24PM (#47892343)
They released a system card talking about how powerful it was. I don't think OpenAI did that with GPT 2.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by satvikpendem on Friday April 24, 2026 @02:51PM (#47894339)
I mean, that's just part of the marketing too. OpenAI would've absolutely added a system card, they just weren't invented back in the GPT 2 era.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by Razele on Saturday April 25, 2026 @07:01AM (#47900446)
too uneconomical to run*
Re:GPT-5.5: Mythos-Like Hacking, Open to All by subscribed on Friday April 24, 2026 @06:01AM (#47888018)
Not sure if the reports like this count? https://www.theregister.com/2026/04/22/mozilla_firefox_mytho...

I don't have strong opinion on that.

Re:GPT-5.5: Mythos-Like Hacking, Open to All by halJordan on Saturday April 25, 2026 @02:50PM (#47903613)
It benches very similarly on the cyber benches Anthropic put out. That meets the bar.
Re:GPT-5.5: Mythos-Like Hacking, Open to All by immanuwell on Friday April 24, 2026 @04:52AM (#47887502)
Those miss-rate numbers are genuinely eye-opening - dropping from 40% to 10% in what sounds like a single generation is no joke - though it's worth taking any vendor-adjacent benchmark with a grain of salt until the broader security community kicks the tires
Re:GPT-5.5: Mythos-Like Hacking, Open to All by cedws on Friday April 24, 2026 @07:55AM (#47888987)
Open to all except it’s not because as soon as you try to use it for security purposes it will shut down and silently route you to a worse model. I was trying to use GPT 5.3 for reverse engineering and got an account warning.