News for hackers. Stuff that matters.
Re:System Card: Claude Mythos Preview [pdf] by babelfish on Tuesday April 07, 2026 @02:26PM (#47679345)
Combined results (Claude Mythos / Claude Opus 4.6 / GPT-5.4 / Gemini 3.1 Pro)

  SWE-bench Verified:        93.9% / 80.8% / —     / 80.6%
  SWE-bench Pro:             77.8% / 53.4% / 57.7% / 54.2%
  SWE-bench Multilingual:    87.3% / 77.8% / —     / —
  SWE-bench Multimodal:      59.0% / 27.1% / —     / —
  Terminal-Bench 2.0:        82.0% / 65.4% / 75.1% / 68.5%

  GPQA Diamond:              94.5% / 91.3% / 92.8% / 94.3%
  MMMLU:                     92.7% / 91.1% / —     / 92.6–93.6%
  USAMO:                     97.6% / 42.3% / 95.2% / 74.4%
  GraphWalks BFS 256K–1M:    80.0% / 38.7% / 21.4% / —

  HLE (no tools):            56.8% / 40.0% / 39.8% / 44.4%
  HLE (with tools):          64.7% / 53.1% / 52.1% / 51.4%

  CharXiv (no tools):        86.1% / 61.5% / —     / —
  CharXiv (with tools):      93.2% / 78.9% / —     / —

  OSWorld:                   79.6% / 72.7% / 75.0% / —
Re:System Card: Claude Mythos Preview [pdf] by sourcecodeplz on Tuesday April 07, 2026 @02:38PM (#47679522)
Haven't seen a jump this large since I don't even know, years? Too bad they are not releasing it anytime soon (there is no need as they are still currently the leader).
Re:System Card: Claude Mythos Preview [pdf] by ru552 on Tuesday April 07, 2026 @02:44PM (#47679611)
There's speculation that next Tuesday will be a big day for OpenAI and possibly GPT 6. Anthropic showed their hand today.
Re:System Card: Claude Mythos Preview [pdf] by enraged_camel on Tuesday April 07, 2026 @02:53PM (#47679727)
That does not sound very believable. Last time Anthropic released a flagship model, it was followed by GPT Codex literally that afternoon.
Re:System Card: Claude Mythos Preview [pdf] by cyanydeez on Tuesday April 07, 2026 @04:11PM (#47680742)
Ya'll know they're teaching to the test. I'll wait till someone devises a novel test that isn't contained in the datasets. Sure, they're still powerful.
Re:System Card: Claude Mythos Preview [pdf] by swalsh on Tuesday April 07, 2026 @04:58PM (#47681287)
My understanding is GPT 6 works via synaptic space reasoning... which I find terrifying. I hope if true, OpenAI does some safety testing on that, beyond what they normally do.
Re:System Card: Claude Mythos Preview [pdf] by coppsilgold on Tuesday April 07, 2026 @05:56PM (#47681848)
Likely an improvement on:

> We study a novel language model architecture that is capable of scaling test-time computation by implicitly reasoning in latent space. Our model works by iterating a recurrent block, thereby unrolling to arbitrary depth at test-time. This stands in contrast to mainstream reasoning models that scale up compute by producing more tokens. Unlike approaches based on chain-of-thought, our approach does not require any specialized training data, can work with small context windows, and can capture types of reasoning that are not easily represented in words. We scale a proof-of-concept model to 3.5 billion parameters and 800 billion tokens. We show that the resulting model can improve its performance on reasoning benchmarks, sometimes dramatically, up to a computation load equivalent to 50 billion parameters.

<https://arxiv.org/abs/2502.05171>

Re:System Card: Claude Mythos Preview [pdf] by tyre on Tuesday April 07, 2026 @05:31PM (#47681610)
From the recent New Yorker piece on Sam:

“My vibes don’t match a lot of the traditional A.I.-safety stuff,” Altman said. He insisted that he continued to prioritize these matters, but when pressed for specifics he was vague: “We still will run safety projects, or at least safety-adjacent projects.” When we asked to interview researchers at the company who were working on existential safety—the kinds of issues that could mean, as Altman once put it, “lights-out for all of us”—an OpenAI representative seemed confused. “What do you mean by ‘existential safety’?” he replied. “That’s not, like, a thing.”

Re:System Card: Claude Mythos Preview [pdf] by actionfromafar on Tuesday April 07, 2026 @06:21PM (#47682105)
Amusing! Even if they believe that, they should know the company communicated the opposite earlier.
Re:System Card: Claude Mythos Preview [pdf] by HDThoreaun on Tuesday April 07, 2026 @10:38PM (#47684289)
No chance an openAI spokesperson doesnt know what existential safety is
Re:System Card: Claude Mythos Preview [pdf] by Barbing on Tuesday April 07, 2026 @11:57PM (#47684998)
I did not read the response as...

>Please provide the definition of Existential Safety.

I read:

>Are you mentally stable? Our product would never hurt humanity--how could any language model?

Re:System Card: Claude Mythos Preview [pdf] by stratos123 on Wednesday April 08, 2026 @06:22AM (#47688109)
The absolute gall of this guy to laugh off a question about x-risks. Meanwhile, also Sam Altman, in 2015: "Development of superhuman machine intelligence is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (for example, an engineered virus with a long incubation period and a high mortality rate) but are unlikely to destroy every human in the universe in the way that SMI could. Also, most of these other big threats are already widely feared." [1]

[1] https://blog.samaltman.com/machine-intelligence-part-1

Re:System Card: Claude Mythos Preview [pdf] by t0lo on Wednesday April 08, 2026 @09:14AM (#47689765)
Why are these people always like this.
Re:System Card: Claude Mythos Preview [pdf] by levocardia on Tuesday April 07, 2026 @05:11PM (#47681425)
Oh you mean literally the thing in AI2027 that gets everyone killed? Wonderful.
Re:System Card: Claude Mythos Preview [pdf] by Turn_Trout on Tuesday April 07, 2026 @09:27PM (#47683624)
AI 2027 is not a real thing which happened. At best, it is informed speculation.
Re:System Card: Claude Mythos Preview [pdf] by mgambati on Tuesday April 07, 2026 @10:21PM (#47684135)
Funny if you open their website and go to April 2026 you literally see this: 26b revenue (Anthropic beat 30b) + pro human hacking (mythos?).

I don’t think predictions, but they did a great call until now.

Re:System Card: Claude Mythos Preview [pdf] by Turn_Trout on Wednesday April 08, 2026 @11:31AM (#47691608)
I agree that they called many things remarkably well! That doesn't change the fact that AI 2027 is not a thing which happened, so it isn't valid to point out "this killed us in AI 2027." There are many reasons to want to preserve CoT monitorability. Instead of AI 2027, I'd point to https://arxiv.org/html/2507.11473.
Re:System Card: Claude Mythos Preview [pdf] by notrealyme123 on Tuesday April 07, 2026 @05:09PM (#47681396)
That's sounds really interesting. Do you have some hints where to read more?
Re:System Card: Claude Mythos Preview [pdf] by arm32 on Tuesday April 07, 2026 @05:12PM (#47681443)
Oh, of course they will /s
Re:System Card: Claude Mythos Preview [pdf] by varispeed on Tuesday April 07, 2026 @05:44PM (#47681736)
Sounds like a good opportunity to pause spending on nerfed 4.6 and wait for the new model to be released and then max out over 2 weeks before it gets nerfed again.
Re:System Card: Claude Mythos Preview [pdf] by SparkyMcUnicorn on Tuesday April 07, 2026 @07:34PM (#47682697)
Re:System Card: Claude Mythos Preview [pdf] by codezero on Tuesday April 07, 2026 @08:10PM (#47682989)
the performance degradation I've seen isn't quality/completion but duration, I get good results but much less quickly than I did before 4.6. Still, it's just anecdata, but a lot of folks seem to feel the same.
Re:System Card: Claude Mythos Preview [pdf] by refulgentis on Tuesday April 07, 2026 @09:10PM (#47683488)
Been reading posts like these for 3 years now. There’s multiple sites with #s. I’m willing to buy “I’m paying rent on someone’s agent harness and god knows what’s in the system prompt rn”, but in the face of numbers, gotta discount the anecdotal.
Re:System Card: Claude Mythos Preview [pdf] by coldtea on Wednesday April 08, 2026 @05:58AM (#47687913)
Yeah, why trust your actual experience over numbers? Nothing surer than synthetic benchmarks
Re:System Card: Claude Mythos Preview [pdf] by refulgentis on Wednesday April 08, 2026 @07:09AM (#47688565)
Strawman, and, synthetic benchmark? :)
Re:System Card: Claude Mythos Preview [pdf] by codezero on Wednesday April 08, 2026 @01:42PM (#47693648)
You're probably right. It's probably more likely that for some period of time I forgot that I switched to the large context Opus vs Sonnet and it was not needed for the level of complexity of my work.
Re:System Card: Claude Mythos Preview [pdf] by andai on Wednesday April 08, 2026 @06:19AM (#47688080)
This just looks like random noise to me? Is it also random on short timespans, like running it 10x in a row?
Re:System Card: Claude Mythos Preview [pdf] by SparkyMcUnicorn on Wednesday April 08, 2026 @08:03PM (#47697736)
Explained in the methodology at the bottom of this page: https://marginlab.ai/trackers/claude-code/
Re:System Card: Claude Mythos Preview [pdf] by dns_snek on Wednesday April 08, 2026 @08:32AM (#47689289)
I don't believe that trackers like this are trustworthy. There's an enormous financial motive to cheat and these companies have a track record of unethical conduct.

If I was VP of Unethical Business Strategy at OpenAI or Anthropic, the first thing I'd do is put in place an automated system which flags accounts, prompts, IPs, and usage patterns associated with these benchmarks and direct their usage to a dedicated compute pool which wouldn't be affected by these changes.

Re:System Card: Claude Mythos Preview [pdf] by Jcampuzano2 on Tuesday April 07, 2026 @03:06PM (#47679901)
A jump that we will never be able to use since we're not part of the seemingly minimum 100 billion dollar company club as requirement to be allowed to use it.

I get the security aspect, but if we've hit that point any reasonably sophisticated model past this point will be able to do the damage they claim it can do. They might as well be telling us they're closing up shop for consumer models.

They should just say they'll never release a model of this caliber to the public at this point and say out loud we'll only get gimped versions.

Re:System Card: Claude Mythos Preview [pdf] by cedws on Tuesday April 07, 2026 @03:18PM (#47680056)
More than killer AI I'm afraid of Anthropic/OpenAI going into full rent-seeking mode so that everyone working in tech is forced to fork out loads of money just to stay competitive on the market. These companies can also choose to give exclusive access to hand picked individuals and cut everyone else off and there would be nothing to stop them.

This is already happening to some degree, GPT 5.3 Codex's security capabilities were given exclusively to those who were approved for a "Trusted Access" programme.

Re:System Card: Claude Mythos Preview [pdf] by TypesWillSaveUs on Tuesday April 07, 2026 @04:01PM (#47680628)
Describing providing a highly valuable service for money as `rent seeking` is pretty wild.
Re:System Card: Claude Mythos Preview [pdf] by 1attice on Tuesday April 07, 2026 @04:07PM (#47680686)
My housing is pretty valuable. I pay rent. Which timeline are you in?
Re:System Card: Claude Mythos Preview [pdf] by kaashif on Tuesday April 07, 2026 @04:43PM (#47681122)
Re:System Card: Claude Mythos Preview [pdf] by 1attice on Tuesday April 07, 2026 @06:00PM (#47681874)
Yes I know that, read your sibling post
Re:System Card: Claude Mythos Preview [pdf] by bonsai_spool on Tuesday April 07, 2026 @04:46PM (#47681155)
Actually you're saying similar things:

Rent-seeking of old was a ground rent, monies paid for the land without considering the building that was on it.

Residential rents today often have implied warrants because of modern law, so your landlord is essentially selling you a service at a particular location.

Re:System Card: Claude Mythos Preview [pdf] by 1attice on Tuesday April 07, 2026 @05:59PM (#47681871)
thanks!
Re:System Card: Claude Mythos Preview [pdf] by mhluongo on Tuesday April 07, 2026 @05:12PM (#47681439)
Two different "rent"s.
Re:System Card: Claude Mythos Preview [pdf] by 1attice on Tuesday April 07, 2026 @05:59PM (#47681867)
Not really see your sibling post
Re:System Card: Claude Mythos Preview [pdf] by bertil on Tuesday April 07, 2026 @04:27PM (#47680927)
It could be, formally, if they have a monopoly.

However, I’m tempted to compare to GitHub: if I join a new company, I will ask to be included to their GitHub account without hesitation. I couldn’t possibly imagine they wouldn’t have one. What makes the cost of that subscription reasonable is not just GitHub’s fear a crowd with pitchforks showing to their office, by also the fact that a possible answer to my non-question might be “Oh, we actually use GitLab.”

If Anthropic is as good as they say, it seems fairly doable to use the service to build something comparable: poach a few disgruntled employees, leverage the promise to undercut a many-trillion-dollar company to be a many-billion dollar company to get investors excited.

I’m sure the founders of Anthropic will have more money than they could possibly spend in ten lifetimes, but I can’t imagine there wouldn’t be some competition. Maybe this time it’s different, but I can’t see how.

Re:System Card: Claude Mythos Preview [pdf] by johnsimer on Tuesday April 07, 2026 @05:14PM (#47681456)
> It could be, formally, if they have a monopoly.

you have 2 labs at the forefront (Anthropic/OpenAI), Google closely behind, xAI/Meta/half a dozen chinese companies all within 6-12 months. There is plenty of competition and price of equally intelligent tokens rapidly drop whenever a new intelligence level is achieved.

Unless the leading company uses a model to nefariously take over or neutralize another company, I don't really see a monopoly happening in the next 3 years.

Re:System Card: Claude Mythos Preview [pdf] by bertil on Tuesday April 07, 2026 @06:01PM (#47681902)
Precisely.

I was focusing on a theoretical dynamic analysis of competition (Would a monopoly make having a competitor easier or harder?) but you are right: practically, there are many players, and they are diverse enough in their values and interest to allow collusion.

We could be wrong: each of those could give birth to as many Basilisks (not sure I have a better name for those conscious, invisible, omni-present, self-serving monsters that so many people imagine will emerge) that coordinate and maintain collusion somehow, but classic economics (complementarity, competition, etc.) points at disruption and lowering costs.

Re:System Card: Claude Mythos Preview [pdf] by eru on Wednesday April 08, 2026 @12:22AM (#47685196)
> practically, there are many players, and they are diverse enough in their values and interest to allow collusion.

Not only that, but open-weight and fully open-source models are also a thing, and not that far behind.

Re:System Card: Claude Mythos Preview [pdf] by coldtea on Wednesday April 08, 2026 @06:03AM (#47687958)
Why, you thought rented homes aren't valuable?

Rent seeking isn't about whether the product has value or not, but about what's extracted in exchage for that value, and whether competition, lack of monopoly, lack of lock in, etc. keeps it realistic.

Re:System Card: Claude Mythos Preview [pdf] by aspenmartin on Tuesday April 07, 2026 @03:26PM (#47680164)
Well don’t forget we still have competition. Were anthropic to rent seek OpenAI would undercut them. Were OpenAI and anthropic to collude that would be illegal. For anthropic to capture the entire coding agent market and THEN rent seek, these days it’s never been easier to raise $1B and start a competing lab
Re:System Card: Claude Mythos Preview [pdf] by cedws on Tuesday April 07, 2026 @03:31PM (#47680231)
In practice this doesn't work though, the Mastercard-Visa duopoly is an example, two competing forces doesn't create aggressive enough competition to benefit the consumer. The only hope we have is the Chinese models, but it will always be too expensive to run the full models for yourself.
Re:System Card: Claude Mythos Preview [pdf] by brokencode on Tuesday April 07, 2026 @04:01PM (#47680614)
New companies can enter this space. Google’s competing, though behind. Maybe Microsoft, Meta, Amazon, or Apple will come out with top notch models at some point.

There is no real barrier to a customer of Anthropic adopting a competing model in the future. All it takes is a big tech company deciding it’s worth it to train one.

On the other hand, Visa/Mastercard have a lot of lock-in due to consumers only wanting to get a card that’s accepted everywhere, and merchants not bothering to support a new type of card that no consumer has. There’s a major chicken and egg problem to overcome there.

Re:System Card: Claude Mythos Preview [pdf] by sghiassy on Tuesday April 07, 2026 @03:46PM (#47680438)
Chinese competition can always be banned. Example: Chinese electric car competition
Re:System Card: Claude Mythos Preview [pdf] by sho_hn on Tuesday April 07, 2026 @03:48PM (#47680456)
That's what OP was saying, I think, noting that running them locally won't be a solution.
Re:System Card: Claude Mythos Preview [pdf] by oblio on Tuesday April 07, 2026 @04:35PM (#47681016)
Also Chinese smartphones. Huawei was about 12-18 months from becoming the biggest smartphone manufacturer in the world a few years ago. If it would have been allowed to sell its phones freely in the US I'm fairly sure Apple would have been closer to Nokia than to current day Apple.
Re:System Card: Claude Mythos Preview [pdf] by aurareturn on Tuesday April 07, 2026 @05:04PM (#47681356)
If Huawei was never banned from using TSMC, they'd likely have a real Nvidia competitor and may have surpassed Apple in mobile chip designs.

They actually beat Apple A series to become the first phone to use the TSMC N7 node.

Re:System Card: Claude Mythos Preview [pdf] by realusername on Wednesday April 08, 2026 @07:39AM (#47688800)
I don't think it will matter too much in the long run, 8 of the top 10 smartphone manufacturers are Chinese, there's nothing the US government can really do.
Re:System Card: Claude Mythos Preview [pdf] by dmantis on Wednesday April 08, 2026 @07:18AM (#47688651)
Just in one particular country. That hurts their labs, but there are ~190 other countries in the world for Chinese to sell their products to, just like they do with their cars.

And businesses from these other countries would happily switch to Chinese. From security perspective both Chinese and US espionage is equally bad, so why care if it all comes down to money and performance.

Re:System Card: Claude Mythos Preview [pdf] by lelanthran on Wednesday April 08, 2026 @03:26AM (#47686573)
> In practice this doesn't work though, the Mastercard-Visa duopoly is an example,

MC/Visa duopoly is an example of lock-in via network effects. Not sure that that applies to a product that isn't affected by how many other people are running it.

Re:System Card: Claude Mythos Preview [pdf] by MattRix on Tuesday April 07, 2026 @04:56PM (#47681276)
The thing is that the current models can ALREADY replicate most software-based products and services on the market. The open source models are not far behind. At a certain point I'm not sure it matters if the frontier models can do faster and better. I see how they're useful for really complex and cutting edge use cases, but that's not what most people are using them for.
Re:System Card: Claude Mythos Preview [pdf] by therealdeal2020 on Tuesday April 07, 2026 @05:02PM (#47681328)
but you are assuming that the magical wizards are the only ones who can create powerful AIs... mind you these people have been born just few decades ago. Their knowledge will be transferred and it will only take a few more decades until anyone can train powerful AIs ... you can only sit on tech for so long before everyone knows how to do it
Re:System Card: Claude Mythos Preview [pdf] by cedws on Tuesday April 07, 2026 @05:10PM (#47681413)
It's not a matter of knowledge, it's a matter of resources. It takes billions of dollars of hardware to train a SOTA LLM and it's increasing all the time. You cannot possibly hope to compete as an independent or small startup.
Re:System Card: Claude Mythos Preview [pdf] by selcuka on Tuesday April 07, 2026 @07:25PM (#47682632)
> It takes billions of dollars of hardware to train a SOTA LLM and it's increasing all the time.

True, but it's also true that the returns from throwing money to the problem are diminishing. Unless one of those big players invents a new, propriatery paradigm, the gap between a SOTA model and an open model that runs on consumer hardware will narrow in the next 5 years.

Re:System Card: Claude Mythos Preview [pdf] by block_dagger on Tuesday April 07, 2026 @05:46PM (#47681752)
Presumably, the hardware to run this level of model will be democratized within the timeframe of the parent comment.
Re:System Card: Claude Mythos Preview [pdf] by walterbell on Tuesday April 07, 2026 @06:28PM (#47682154)
Re:System Card: Claude Mythos Preview [pdf] by wincy on Wednesday April 08, 2026 @01:26AM (#47685681)
Eventually these super expensive SXM data center GPUs will cost pennies on the dollar, and we’ll be able to snatch up H200s for our homelabs. Give it a decade.

Also eventually these WEIGHTS will leak. You can’t have the world’s most valuable data that can just be copied to a hard drive stay in the bottle forever, even if it’s worth a billion dollars. Somehow, some way, that genie’s going to get out, be it by some spiteful employee with nothing to lose, some state actor, or just a fuck up of epic proportions.

Re:System Card: Claude Mythos Preview [pdf] by WorldPeas on Wednesday April 08, 2026 @02:04PM (#47693969)
at the point where those gpus cost pennies, they likely won't even be worth the electricity that goes into them, better models would run on laptops.
Re:System Card: Claude Mythos Preview [pdf] by marcus_holmes on Tuesday April 07, 2026 @08:57PM (#47683364)
Unless, of course, the powerful manage to scare everyone about how the machines will kill us all and so AI technology needs to be properly controlled by the relevant authorities, and anyone making/using an unlicensed AI is arrested and jailed.
Re:System Card: Claude Mythos Preview [pdf] by robwwilliams on Tuesday April 07, 2026 @06:12PM (#47682019)
With Gemma-4 open and running on laptops and phones I see the flip side. How many non-HN users or researchers even need Opus 4.6e level performance? OpenAI, Anthropric and Google may be “rent seeking” from large corporations — like the Oracles and IBMs.
Re:System Card: Claude Mythos Preview [pdf] by baq on Wednesday April 08, 2026 @08:29AM (#47689265)
Everyone, once AI diffuses enough. You’ll be unhireable if you don’t use AI in a year or two.
Re:System Card: Claude Mythos Preview [pdf] by eru on Wednesday April 08, 2026 @12:20AM (#47685187)
You know, they have competitors?
Re:System Card: Claude Mythos Preview [pdf] by alwillis on Wednesday April 08, 2026 @03:51AM (#47686819)
> More than killer AI I'm afraid of Anthropic/OpenAI going into full rent-seeking mode so that everyone working in tech is forced to fork out loads of money just to stay competitive on the market.

You should be more concerned about killer AI than rent seeking by OpenAI and Anthropic. AI evolving to the point of losing control is what scientists and researchers have predicted for years; they didn’t think it would happen this quickly but here we are.

This market is hyper competitive; the models from China and other labs are just a level or two below the frontier labs.

Re:System Card: Claude Mythos Preview [pdf] by quotemstr on Tuesday April 07, 2026 @03:16PM (#47680033)
This is why the EAs, and their almost comic-book-villain projects like "control AI dot com" cannot be allowed to win. One private company gatekeeping access to revolutionary technology is riskier than any consequence of the technology itself.
Re:System Card: Claude Mythos Preview [pdf] by FeepingCreature on Tuesday April 07, 2026 @03:53PM (#47680522)
No it isn't lol. The consequence of the technology literally includes human extinction. I prefer 0 companies, but I'll take 1 over 5.
Re:System Card: Claude Mythos Preview [pdf] by frozenseven on Tuesday April 07, 2026 @03:42PM (#47680387)
Couldn't agree more. The "safest" AI company is actually the biggest liability. I hope other companies make a move soon.
Re:System Card: Claude Mythos Preview [pdf] by scrawl on Tuesday April 07, 2026 @04:23PM (#47680881)
Having done a quick search of "control AI dot com", it seems their intent is educate lawmakers & government in order to aid development of a strong regulatory framework around frontier AI development.

Not sure how this is consistent with "One private company gatekeeping access to revolutionary technology"?

Re:System Card: Claude Mythos Preview [pdf] by quotemstr on Tuesday April 07, 2026 @05:04PM (#47681352)
> strong regulatory framework around frontier AI development

You have to decode feel-good words into the concrete policy. The EAs believe that the state should prohibit entities not aligned with their philosophy to develop AIs beyond a certain power level.

Re:System Card: Claude Mythos Preview [pdf] by arw0n on Wednesday April 08, 2026 @05:16AM (#47687499)
And what is malicious about that ideology? I think EAs tend to like the smell of their farts way too much, but their views on AI safety don't seem so bad. I think their thoughts on hypothetical super intelligence or AGI are too focused on control (alignment) and should also focus on AI welfare, but that's more a point of disagreement that I doubt they'd try to forbid.
Re:System Card: Claude Mythos Preview [pdf] by guzfip on Tuesday April 07, 2026 @03:18PM (#47680063)
> A jump that we will never be able to use since we're not part of the seemingly minimum 100 billion dollar company club as requirement to be allowed to use it.

> They should just say they'll never release a model of this caliber to the public at this point and say out loud we'll only get gimped

Duh, this was fucking obvious from the start. The only people saying otherwise were zealots who needed a quick line to dismiss legitimate concerns.

Re:System Card: Claude Mythos Preview [pdf] by marcus_holmes on Tuesday April 07, 2026 @08:55PM (#47683350)
This is my nightmare about AI; not that the machines will kill all the humans, but that access is preferentially granted to the powerful and it's used to maintain the current power structure in blatant disregard of our democratic and meritocratic ideals, probably using "security" as the justification (as usual).
Re:System Card: Claude Mythos Preview [pdf] by ben_w on Wednesday April 08, 2026 @03:33AM (#47686646)
> I get the security aspect, but if we've hit that point any reasonably sophisticated model past this point will be able to do the damage they claim it can do. They might as well be telling us they're closing up shop for consumer models.

I read it like I always read the GPT-2 announcement no matter what others say: It's *not* being called "too dangerous to ever release", but rather "we need to be mindful, knowing perfectly well that other AI companies can replicate this imminently".

The important corps (so presumably including the Linux Foundation, bigger banks and power stations, and quite possibly excluding x.com) will get access now, and some other LLM which is just as capable will give it to everyone in 3 months time at which point there's no benefit to Anthropic keeping it off-limits.

Re:System Card: Claude Mythos Preview [pdf] by alwillis on Wednesday April 08, 2026 @03:36AM (#47686671)
> They should just say they'll never release a model of this caliber to the public at this point and say out loud we'll only get gimped versions.

That’s not going to happen. If you recall, OpenAI didn’t release a model a few years ago because they felt it was too dangerous.

Anthropic is giving the industry a heads up and time to patch their software.

They said there are exploitable vulnerabilities in every major operating system.

But in 6 months every frontier model will be able to do the same things. So Anthropic doesn’t have the luxury of not shipping their best models. But they also have to be responsible as well.

Re:System Card: Claude Mythos Preview [pdf] by mike_hearn on Wednesday April 08, 2026 @09:23AM (#47689898)
I think they already said somewhere that they can't release Mythos because it requires absurdly large amounts of compute. The economics of releasing it just don't work.
Re:System Card: Claude Mythos Preview [pdf] by yencabulator on Wednesday April 08, 2026 @04:57PM (#47696161)
Yet they quote a $20,000 cost for one of the exploits.
Re:System Card: Claude Mythos Preview [pdf] by lumost on Tuesday April 07, 2026 @06:05PM (#47681946)
Is this even real? coming off the heals of GLM5.1's announcement this feels almost like a llama 4 launch to hedge off competition.
Re:System Card: Claude Mythos Preview [pdf] by m3kw9 on Wednesday April 08, 2026 @10:23AM (#47690662)
not much of a jump 94.5% / 91.3%
Re:System Card: Claude Mythos Preview [pdf] by enraged_camel on Wednesday April 08, 2026 @11:19AM (#47691438)
Actually, going from 91.3% to 94.5% is a significant jump, because it means the model has gotten a lot better at solving the hardest problems thrown at it. This has downstream effects as well: it means that during long implementation tasks, instead of getting stuck at the most challenging parts and stopping (or going in loops!), it can now get past them to finish the implementation.
Re:System Card: Claude Mythos Preview [pdf] by kkoncevicius on Wednesday April 08, 2026 @01:28PM (#47693442)
We can look at the same numbers in different way:

  Error with 91.3% = 8.7%
  Error with 94.5% = 5.5%

  Error reduction = 8.7% - 5.5% = 3.2%
So the improvement is 3.2% / 8.7% = 36.8%
Re:System Card: Claude Mythos Preview [pdf] by WarmWash on Tuesday April 07, 2026 @03:42PM (#47680386)
Are these fair comparisons? It seems like mythos is going to be like a 5.4 ultra or Gemini Deepthink tier model, where access is limited and token usage per query is totally off the charts.
Re:System Card: Claude Mythos Preview [pdf] by mulmboy on Tuesday April 07, 2026 @04:07PM (#47680693)
There are a few hints in the doc around this

> Importantly, we find that when used in an interactive, synchronous, “hands-on-keyboard” pattern, the benefits of the model were less clear. When used in this fashion, some users perceived Mythos Preview as too slow and did not realize as much value. Autonomous, long-running agent harnesses better elicited the model’s coding capabilities. (p201)

^^ From the surrounding context, this could just be because the model tends to do a lot of work in the background which naturally takes time.

> Terminal-Bench 2.0 timeouts get quite restrictive at times, especially with thinking models, which risks hiding real capabilities jumps behind seemingly uncorrelated confounders like sampling speed. Moreover, some Terminal-Bench 2.0 tasks have ambiguities and limited resource specs that don’t properly allow agents to explore the full solution space — both being currently addressed by the maintainers in the 2.1 update. To exclusively measure agentic coding capabilities net of the confounders, we also ran Terminal-Bench with the latest 2.1 fixes available on GitHub, while increasing the timeout limits to 4 hours (roughly four times the 2.0 baseline). This brought the mean reward to 92.1%. (p188)

> ...Mythos Preview represents only a modest accuracy improvement over our best Claude Opus 4.6 score (86.9% vs. 83.7%). However, the model achieves this score with a considerably smaller token footprint: the best Mythos Preview result uses 4.9× fewer tokens per task than Opus 4.6 (226k vs. 1.11M tokens per task). (p191)

Re:System Card: Claude Mythos Preview [pdf] by alyxya on Tuesday April 07, 2026 @05:01PM (#47681323)
The first point is along the lines of what I'd expect given that claude code is generally reliable at this point. A model's raw intelligence doesn't seem as important right now compared to being able to support arbitrary length context.
Re:System Card: Claude Mythos Preview [pdf] by zozbot234 on Tuesday April 07, 2026 @06:18PM (#47682081)
Good catch. If it's "too slow" even when ran in a state-of-the-art datacenter environment, this "Mythos" model is most closely comparable to the "Deep Research" modes for GPT and Gemini, which Claude formerly lacked any direct equivalent for.
Re:System Card: Claude Mythos Preview [pdf] by stalfie on Wednesday April 08, 2026 @08:00AM (#47689005)
I don't think that's what's being hinted at. The system card seems to say that the model is both token efficient and slow in practice. Deep research modes generally work by having many subagents/large token spend. So this more likely the fact that each token just takes longer to produce, which would be because the model is simply much larger.

By epoch AIs datacenter tracking methods, anthropic has had access to the largest amount of contiguous compute since late last year. So this might simply be the end result result of being the first to have the capacity to conduct a training run of this size. Or the first seemingly successful one at any rate.

Re:System Card: Claude Mythos Preview [pdf] by zozbot234 on Wednesday April 08, 2026 @08:58AM (#47689564)
"Slow and token-efficient" could be achieved quite trivially by taking an existing large MoE model and increasing the amount of active experts per layer, thus decreasing sparsity. The broader point is that to end users, Mythos behaves just like Deep Research: having it be "more token efficient" compared to running swarms of subagents is not something that impacts them directly.
Re:System Card: Claude Mythos Preview [pdf] by derangedHorse on Wednesday April 08, 2026 @12:21AM (#47685188)
The quote comparing them here was for BrowseComp which "tests an agent's ability to find hard-to-locate information on the open web." (for those wondering). The new model seems significantly better than Opus4.6 judging by the 'Overall results summary'
Re:System Card: Claude Mythos Preview [pdf] by naasking on Wednesday April 08, 2026 @11:40AM (#47691740)
I'm curious if frontier labs use any forms of compression on their models to improve performance. The small % drop of Q8 or FP8 would still put it ahead of Opus, but should double token throughput. Maybe then interactive use would feel like an improvement.
Re:System Card: Claude Mythos Preview [pdf] by rachel_rig on Thursday April 09, 2026 @09:01PM (#47712294)
If it only really shines once you give it a long leash and hours to work, that’s a rough fit for actual hands-on coding. A lot of that pain is just cloud round-trip tax showing up in the product, which is a big part of why we’re building rig.ai around local inference and a tight interactive loop.
Re:System Card: Claude Mythos Preview [pdf] by pants2 on Tuesday April 07, 2026 @02:37PM (#47679508)
We're gonna need some new benchmarks...

ARC-AGI-3 might be the only remaining benchmark below 50%

Re:System Card: Claude Mythos Preview [pdf] by Leynos on Tuesday April 07, 2026 @04:08PM (#47680706)
Opus 4.6 currently leads the remote labor index at 4.17. GPT-5.4 isn't measured on that one though: https://www.remotelabor.ai/

GPT 5.4 Pro leads Frontier Maths Tier 4 at 35%: https://epoch.ai/benchmarks/frontiermath-tier-4/

[dead]
Re:System Card: Claude Mythos Preview [pdf] by saberience on Wednesday April 08, 2026 @06:14AM (#47688042)
I've never understood the point of things like HLE, it doesn't really prove or show anything since 99.99% of humans can't do a single question on this exam.

That is, it's easy to make benchmarks which humans are bad at, humans are really bad at many things.

Divide 123094382345234523452345111 by 0.1234243131324, guess what, humans would find that hard, computers easy. But it doesn't mean much.

Humanity's last exam (HLE) couldn't be completed by most of humanity, the vast majority, so it doesn't really capture anything about humanity or mean much if a computer can do it.

[dead]
Re:System Card: Claude Mythos Preview [pdf] by elfly on Wednesday April 08, 2026 @03:11PM (#47694851)
I mean they could just feed the solutions into the training data. Then suddenly the bot will do real good at HLE.
Re:System Card: Claude Mythos Preview [pdf] by mbesto on Thursday April 09, 2026 @02:24PM (#47707507)
Exactly. This is called overfitting and it's most definitely a thing.
Re:System Card: Claude Mythos Preview [pdf] by mbesto on Thursday April 09, 2026 @02:23PM (#47707500)
> We're gonna need some new benchmarks...

You can't consistently benchmark something that is qualitative by nature. I'm struggling to understand how people don't understand this.

Re:System Card: Claude Mythos Preview [pdf] by simianwords on Tuesday April 07, 2026 @03:07PM (#47679915)
The real part is SWE-bench Verified since there is no way to overfit. That's the only one we can believe.
Re:System Card: Claude Mythos Preview [pdf] by ollin on Tuesday April 07, 2026 @03:26PM (#47680158)
My impression was entirely the opposite; the unsolved subset of SWE-bench verified problems are memorizable (solutions are pulled from public GitHub repos) and the evaluators are often so brittle or disconnected from the problem statement that the only way to pass is to regurgitate a memorized solution.

OpenAI had a whole post about this, where they recommended switching to SWE-bench Pro as a better (but still imperfect) benchmark:

https://openai.com/index/why-we-no-longer-evaluate-swe-bench...

> We audited a 27.6% subset of the dataset that models often failed to solve and found that at least 59.4% of the audited problems have flawed test cases that reject functionally correct submissions

> SWE-bench problems are sourced from open-source repositories many model providers use for training purposes. In our analysis we found that all frontier models we tested were able to reproduce the original, human-written bug fix

> improvements on SWE-bench Verified no longer reflect meaningful improvements in models’ real-world software development abilities. Instead, they increasingly reflect how much the model was exposed to the benchmark at training time

> We’re building new, uncontaminated evaluations to better track coding capabilities, and we think this is an important area to focus on for the wider research community. Until we have those, OpenAI recommends reporting results for SWE-bench Pro.

Re:System Card: Claude Mythos Preview [pdf] by simianwords on Tuesday April 07, 2026 @04:02PM (#47680633)
I stand corrected.
Re:System Card: Claude Mythos Preview [pdf] by simianwords on Wednesday April 08, 2026 @04:40PM (#47695966)
> My impression was entirely the opposite; the unsolved subset of SWE-bench verified problems are memorizable (solutions are pulled from public GitHub repos) and the evaluators are often so brittle or disconnected from the problem statement that the only way to pass is to regurgitate a memorized solution.

Anthropic accounts for this

>To detect memorization, we use a Claude-based auditor that compares each model-generated patch against the gold patch and assigns a [0, 1] memorization probability. The auditor weighs concrete signals—verbatim code reproduction when alternative approaches exist, distinctive comment text matching ground truth, and more—and is instructed to discount overlap that any competent solver would produce given the problem constraints.

Re:System Card: Claude Mythos Preview [pdf] by whalesalad on Tuesday April 07, 2026 @02:50PM (#47679688)
Honestly we are all sleeping on GPT-5.4. Particularly with the influx of Claude users recently (and increasingly unstable platform) Codex has been added to my rotation and it's surprising me.
Re:System Card: Claude Mythos Preview [pdf] by rafaelmn on Tuesday April 07, 2026 @02:56PM (#47679757)
GPT is shit at writing code. It's not dumb - extra high thinking is really good at catching stuff - but it's like letting a smart junior into your codebase - ignore all the conventions, surrounding context, just slop all over the place to get it working. Claude is just a level above in terms of editing code.
Re:System Card: Claude Mythos Preview [pdf] by Jcampuzano2 on Tuesday April 07, 2026 @03:03PM (#47679851)
Not my experience. GPT 5.4 walks all over Claude from what I've worked with and its Claude that is the one willing to just go do unnecessary stuff that was never asked for or implement the more hacky solutions to things without a care for maintainability/readability.

But I do not use extra high thinking unless its for code review. I sit at GPT 5.4 high 95% of the time.

Re:System Card: Claude Mythos Preview [pdf] by sho_hn on Tuesday April 07, 2026 @03:22PM (#47680123)
Very different experience for me. Codex 5.3+ on xhigh are the only models I've tried so far that write reasonably decent C++ (domains: desktop GUI, robotics, game engine dev, embedded stuff, general systems engineering-type codebases), and idiomatic code in languages not well-represented in training data, e.g. QML. One thing I like is explicitly that it knows better when to stop, instead of brute-forcing a solution by spamming bespoke helpers everywhere no rational dev would write that way.

Not always, no, and it takes investment in good prompting/guardrails/plans/explicit test recipes for sure. I'm still on average better at programming in context than Codex 5.4, even if slower. But in terms of "task complexity I can entrust to a model and not be completely disappointed and annoyed", it scores the best so far. Saves a lot on review/iteration overhead.

It's annoying, too, because I don't much like OpenAI as a company.

(Background: 25 years of C++ etc.)

Re:System Card: Claude Mythos Preview [pdf] by boring-human on Tuesday April 07, 2026 @05:09PM (#47681410)
Same background as you, and same exact experience as you. Opus and Gemini have not come close to Codex for C++ work. I also run exclusively on xhigh. Its handling of complexity is unmatched.

At least until next week when Mythos and GPT 6 throw it all up in the air again.

Re:System Card: Claude Mythos Preview [pdf] by zarzavat on Tuesday April 07, 2026 @03:05PM (#47679878)
Yes, it's becoming clear that OpenAI kinda sucks at alignment. GPT-5 can pass all the benchmarks but it just doesn't "feel good" like Claude or Gemini.
Re:System Card: Claude Mythos Preview [pdf] by lilytweed on Tuesday April 07, 2026 @03:17PM (#47680042)
Whenever I come back to ChatGPT after using Claude or Gemini for an extended period, I’m really struck by the “AI-ness.” All the verbal tics and, truly, sloppishness, have been trained away by the other, more human-feeling models at this point.
Re:System Card: Claude Mythos Preview [pdf] by kranke155 on Tuesday April 07, 2026 @05:59PM (#47681862)
GPT was clearly changed after its sycophantic models lead to the lawsuits.
Re:System Card: Claude Mythos Preview [pdf] by josephg on Tuesday April 07, 2026 @07:10PM (#47682497)
It still has a very ... plastic feeling. The way it writes feels cheap somehow. I don't know why, but Claude seems much more natural to me. I enjoy reading its writing a lot more.

That said, I'll often throw a prompt into both claude and chatgpt and read both answers. GPT is frequently smarter.

Re:System Card: Claude Mythos Preview [pdf] by kranke155 on Wednesday April 08, 2026 @06:14AM (#47688045)
GPT is more accurate. But Claude has this way of association between things that seems smarter and more human to me.
Re:System Card: Claude Mythos Preview [pdf] by chaos_emergent on Tuesday April 07, 2026 @03:32PM (#47680246)
An alternative but similar formulation of that statement is that Anthropic has spent more training effort in getting the model to “feel good” rather than being correct on verifiable tasks. Which more or less tracks with my experience of using the model.
Re:System Card: Claude Mythos Preview [pdf] by zarzavat on Wednesday April 08, 2026 @07:50AM (#47688900)
Alignment is a subspace of capability. Feeling good is nice, but it's also a manifestation of the level that the model can predict what I do and don't want it to do. The more accurately it can predict my intentions without me having to spell them out explicitly in the prompt, the more helpful it is.

GPT-5 is good at benchmarks, but benchmarks are more forgiving of a misaligned model. Many real world tasks often don't require strong reasoning abilities or high intelligence, so much as the ability to understand what the task is with a minimal prompt.

Not every shop assistant needs a physics degree, and not every physics professor is necessarily qualified to be a shop assistant. A person, or LLM, can be very smart while at the same time very bad at understanding people.

For example, if GPT-5 takes my code and rearranges something for no reason, that's not going to affect its benchmarks because the code will still produce the same answers. But now I have to spend more time reviewing its output to make sure it hasn't done that. The more time I have to spend post-processing its output, the lower its capabilities are since the measurement of capability on real world tasks is often the amount of time saved.

Re:System Card: Claude Mythos Preview [pdf] by leobuskin on Tuesday April 07, 2026 @03:02PM (#47679842)
And as a bonus: GPT is slow. I’m doing a lot of RE (IDA Pro + MCP), even when 5.4 gives a little bit better guesses (rarely, but happens) - it takes x2-x4 longer. So, it’s just easier to reiterate with Opus
Re:System Card: Claude Mythos Preview [pdf] by blazespin on Tuesday April 07, 2026 @04:48PM (#47681177)
Yeah, need some good RE benchmarks for the LLMs. :)

RE is very interesting problem. A lot more that SWE can be RE'd. I've found the LLMs are reluctant to assist, though you can workaround.

Re:System Card: Claude Mythos Preview [pdf] by porker on Tuesday April 07, 2026 @05:02PM (#47681340)
What is RE in this context?
Re:System Card: Claude Mythos Preview [pdf] by astrange on Tuesday April 07, 2026 @05:16PM (#47681473)
Reverse engineering
Re:System Card: Claude Mythos Preview [pdf] by 19h on Tuesday April 07, 2026 @07:53PM (#47682852)
Mind sharing the use cases you're using IDA via MCP for?
Re:System Card: Claude Mythos Preview [pdf] by aizk on Tuesday April 07, 2026 @09:57PM (#47683908)
I've been messing with using Claude, Codex, and Kimi even for reverse engineering at https://decomp.dev/ it's a ton of fun. Great because matching bytes is a scoring function that's easy for the models to understand and make progress on.
Re:System Card: Claude Mythos Preview [pdf] by adamgoodapp on Wednesday April 08, 2026 @03:34AM (#47686653)
I want to get into RE with AI. Which model you liking the most?
Re:System Card: Claude Mythos Preview [pdf] by rustystump on Wednesday April 08, 2026 @11:20AM (#47691462)
This. People drastically underestimate how much more useful a lightning fast slightly dumb model is compared to a super smart but mega slow model is. Sure, u may need to bust out the beef now and then. However, the overwhelming majority of work the fast stupid model is a better fit.
Re:System Card: Claude Mythos Preview [pdf] by whalesalad on Tuesday April 07, 2026 @02:59PM (#47679805)
This has been my experience. With very very rigid constraints it does ok, but without them it will optimize expediency and getting it done at the expense of integrating with the broader system.
Re:System Card: Claude Mythos Preview [pdf] by ctoth on Tuesday April 07, 2026 @03:35PM (#47680290)
My favorite example of this from last night:

Me: Let's figure out how to clone our company Wordpress theme in Hugo. Here're some tools you can use, here's a way to compare screenshots, iterate until 0% difference.

Codex: Okay Boss! I did the thing! I couldn't get the CSS to match so I just took PNGs of the original site and put them in place! Matches 100%!

Re:System Card: Claude Mythos Preview [pdf] by camdenreslink on Tuesday April 07, 2026 @06:05PM (#47681956)
ChatGPT 5.4 with extra high reasoning has worked really well for me, and I don't notice a huge difference with Opus 4.6 with high reasoning (those are the 2 models/thinking modes I've used the most in the last month or so).
Re:System Card: Claude Mythos Preview [pdf] by babelfish on Tuesday April 07, 2026 @02:56PM (#47679759)
Totally. Best-in-class for SWE work (until Mythos gets released, if ever, but I suspect the rumored "Spud" will be out by then too)
Re:System Card: Claude Mythos Preview [pdf] by girvo on Tuesday April 07, 2026 @04:21PM (#47680856)
It really isn’t. I wish it was, because work complains about overuse of Opus.
Re:System Card: Claude Mythos Preview [pdf] by jeswin on Tuesday April 07, 2026 @08:16PM (#47683032)
It really is, for complex tasks. Claude excels at low-mid complexity (CRUD apps, most business apps). For anything somewhat out of the distribution, codex at the moment has no peer.
Re:System Card: Claude Mythos Preview [pdf] by ttul on Tuesday April 07, 2026 @11:52PM (#47684963)
I find that more experienced devs are more likely to prefer Codex… anecdotal but… it’s a thing.
Re:System Card: Claude Mythos Preview [pdf] by xvector on Wednesday April 08, 2026 @12:26AM (#47685227)
This is because no one bothers to set thinking to high, as it now defaults to medium in CC.

Once you set thinking to high it works just as well as 5.4 even for pretty complex tasks

Re:System Card: Claude Mythos Preview [pdf] by jeswin on Wednesday April 08, 2026 @01:20AM (#47685624)
I have always used Claude at max thinking levels since it launched. It has never been up to the task. For clarity, the task being this: https://github.com/tsoniclang/tsonic

Meanwhile, there are half a dozen other projects (business apps, web apps etc) where it works well.

Re:System Card: Claude Mythos Preview [pdf] by AlexC04 on Tuesday April 07, 2026 @04:20PM (#47680853)
but how does it perform on pelican riding a bicycle bench? why are they hiding the truth?!

(edit: I hope this is an obvious joke. less facetiously these are pretty jaw dropping numbers)

Re:System Card: Claude Mythos Preview [pdf] by bertil on Tuesday April 07, 2026 @04:30PM (#47680961)
We are all fans for Simon’s work, and his test is, strangely enough, quite good.
Re:System Card: Claude Mythos Preview [pdf] by ninjagoo on Tuesday April 07, 2026 @05:11PM (#47681436)
> Combined results (Claude Mythos / Claude Opus 4.6 / GPT-5.4 / Gemini 3.1 Pro)

> Terminal-Bench 2.0: 82.0% / 65.4% / 75.1% / 68.5%

> GPQA Diamond: 94.5% / 91.3% / 92.8% / 94.3%

> MMMLU: 92.7% / 91.1% / — / 92.6–93.6%

> USAMO: 97.6% / 42.3% / 95.2% / 74.4%

> OSWorld: 79.6% / 72.7% / 75.0% / —

Given that for a number of these benchmarks, it seems to be barely competitive with the previous gen Opus 4.6 or GPT-5.4, I don't know what to make of the significant jumps on other benchmarks within these same categories. Training to the test? Better training?

And the decision to withhold general release (of a 'preview' no less!) seems to be well, odd. And the decision to release a 'preview' version to specific companies? You know any production teams at these massive companies that would work with a 'preview' anything? R&D teams, sure, but production? Part of me wants to LoL.

What are they trying to do? Induce FOMO and stop subscriber bleed-out stemming from the recent negative headlines around problems with using Claude?

Re:System Card: Claude Mythos Preview [pdf] by TacticalCoder on Tuesday April 07, 2026 @05:21PM (#47681519)
> Given that for a number of these benchmarks, it seems to be barely competitive with the previous gen

We're not reading the same numbers I think. Compared to Opus 4.6, it's a big jump nearly in every single bench GP posted. They're "only" catching up to Google's Gemini on GPQA and MMMLU but they're still beating their own Opus 4.6 results on these two.

This sounds like a much better model than Opus 4.6.

Re:System Card: Claude Mythos Preview [pdf] by ninjagoo on Tuesday April 07, 2026 @05:34PM (#47681644)
> We're not reading the same numbers I think.

We must not be.

That's why I listed out the ones where it is barely competitive from @babelfish's table, which itself is extracted from Pg 186 & 187 of the System Card, which has the comparison with Opus 4.6, GPT 5.4 and Gemini 3.1 Pro.

Sure, it may be better than Opus 4.6 on some of those, but barely achieves a small increase over GPT-5.4 on the ones I called out.

Re:System Card: Claude Mythos Preview [pdf] by nimchimpsky on Tuesday April 07, 2026 @05:56PM (#47681846)
barely competitive ? Mythos column is the first column.

You are the only person with this take on hackernews, everyone else "this is a massive a jump". Fwiwi, the data you list shows the biggest jump I remember for mythos

Re:System Card: Claude Mythos Preview [pdf] by devmor on Tuesday April 07, 2026 @06:48PM (#47682344)
The biggest jump in the numbers they quoted is 6%.

Please look at the columns OTHER than Opus as well.

Re:System Card: Claude Mythos Preview [pdf] by josephg on Tuesday April 07, 2026 @07:03PM (#47682452)
> Combined results (Claude Mythos / Claude Opus 4.6 / GPT-5.4 / Gemini 3.1 Pro)

> Terminal-Bench 2.0: 82.0% / 65.4% / 75.1% / 68.5%

> USAMO: 97.6% / 42.3% / 95.2% / 74.4%

> The biggest jump in the numbers they quoted is 6%.

Just in the numbers you quoted, thats a 16.6% jump in terminal-bench and a 55.3% absolute increase in USAMO over their previous Opus 4.6 model.

Re:System Card: Claude Mythos Preview [pdf] by devmor on Tuesday April 07, 2026 @07:13PM (#47682529)
I don’t know if you’re willingly disregarding everything being said to you or there’s a language barrier here.
Re:System Card: Claude Mythos Preview [pdf] by dang on Friday April 10, 2026 @11:29AM (#47719615)
Can you please stop posting comments with personal swipes in them? You've unfortunately been doing it repeatedly. It's not what this site is for, and destroys what it is for.

If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.

Re:System Card: Claude Mythos Preview [pdf] by devmor on Friday April 10, 2026 @06:31PM (#47724516)
You're right, I apologize for that. I have been responding with annoyance rather than walking away when I receive replies that appear to be ignoring context.
Re:System Card: Claude Mythos Preview [pdf] by dang on Friday April 10, 2026 @11:16PM (#47726978)
Appreciated! and of course, I know it's not easy - believe me I know...
Re:System Card: Claude Mythos Preview [pdf] by nl on Tuesday April 07, 2026 @09:12PM (#47683502)
It's higher than all other models except vs Gemini 3.1 Pro on MMMLU
Re:System Card: Claude Mythos Preview [pdf] by DroneBetter on Wednesday April 08, 2026 @06:45AM (#47688292)
this just in: HN user forgets how sigmoid functions work
Re:System Card: Claude Mythos Preview [pdf] by dang on Friday April 10, 2026 @11:29AM (#47719627)
Please don't respond to a bad comment by breaking the site guidelines yourself. That only makes things worse.

https://news.ycombinator.com/newsguidelines.html

Re:System Card: Claude Mythos Preview [pdf] by nl on Tuesday April 07, 2026 @09:11PM (#47683495)
> barely competitive

It's higher than all other models except vs Gemini 3.1 Pro on MMMLU

MMMLU is generally thought to be maxed out - as it it might not be possible to score higher than those scores.

> Overall, they estimated that 6.5% of questions in MMLU contained an error, suggesting the maximum attainable score was significantly below 100%[1]

Other models get close on GPQA Diamond, but it wouldn't be surprising to anyone if the max possible on that was around the 95% the top models are scoring.

[1] https://en.wikipedia.org/wiki/MMLU

Re:System Card: Claude Mythos Preview [pdf] by lostmsu on Wednesday April 08, 2026 @08:34AM (#47689312)
You are reading the percentages wrong.

Because 100% is maximum, you should be looking at error rates instead. GPT has 25% on Terminal Bench and the new model has 18%, almost 1.4x reduction.

Re:System Card: Claude Mythos Preview [pdf] by enraged_camel on Tuesday April 07, 2026 @06:16PM (#47682051)
Let's be clear: your entire post is just pure, unadulterated FUD. You first claim, based on cherry-picked benchmarks, that Mythos is actually only "barely competitive" with existing models, then suggest they must be training to the test, then call it "odd" that they are withholding the release despite detailed and forthcoming explanations from Anthropic regarding why they are doing that, then wrap it up with the completely unsubstantiated that they must be bleeding subscribers and that this must just be to stop that bleed.
Re:System Card: Claude Mythos Preview [pdf] by johnnichev on Tuesday April 07, 2026 @05:53PM (#47681822)
damn... ok that's impressive.
Re:System Card: Claude Mythos Preview [pdf] by WinstonSmith84 on Tuesday April 07, 2026 @06:39PM (#47682265)
Not discussing Mythos here, but Opus. Opus to me has been significantly better at SWE than GPT or Gemini - that gets me confused why Opus is ranking clearly lower than GPT, and even lower than Gemini.
Re:System Card: Claude Mythos Preview [pdf] by muyuu on Tuesday April 07, 2026 @08:37PM (#47683201)
When did you last compare them? Codex right now is considerably better in my experience. Can't speak for Gemini.
Re:System Card: Claude Mythos Preview [pdf] by gck1 on Tuesday April 07, 2026 @09:22PM (#47683584)
Tried Gemini 2 weeks ago to see where it's at, with gemini-cli.

Failed to use tools, failed to follow instructions, and then went into deranged loop mode.

Essentially, it's where it was 1.5 years ago when I tried it the last time.

It's honestly unbelievable how Google managed to fail so miserably at this.

Re:System Card: Claude Mythos Preview [pdf] by 4b11b4 on Tuesday April 07, 2026 @09:42PM (#47683759)
Their harness might be behind
Re:System Card: Claude Mythos Preview [pdf] by gck1 on Tuesday April 07, 2026 @10:25PM (#47684169)
I think failures that I observed with gemini are unrelated to the harness. Because the same failures happened with third party harnesses too.
Re:System Card: Claude Mythos Preview [pdf] by unsupp0rted on Wednesday April 08, 2026 @07:19AM (#47688663)
It’s great on AI Studio. Harness issues, I agree.
Re:System Card: Claude Mythos Preview [pdf] by Kailhus on Saturday April 11, 2026 @12:10PM (#47731753)
I have not experienced any issues with Gemini 3.1 Pro.
Re:System Card: Claude Mythos Preview [pdf] by sandos on Wednesday April 08, 2026 @03:30AM (#47686623)
Agree, I never actually had great success with Opus. I think its the failures that are annoying, its probably better than codex when its "good", but it fails in annoying ways that I think codex very seldom does.
Re:System Card: Claude Mythos Preview [pdf] by StingyJelly on Wednesday April 08, 2026 @07:09AM (#47688563)
I wouldn't call codex considerably better. It may depend on specific codebase and your expectations, but codex produces more "abstraction for the sake of abstraction" even on simple tasks, while opus in my experience usually chooses right level of abstraction for given task.
Re:System Card: Claude Mythos Preview [pdf] by otabdeveloper4 on Wednesday April 08, 2026 @07:13AM (#47688597)
A secret art known to the cognoscenti as "benchmark gaming".
Re:System Card: Claude Mythos Preview [pdf] by matheusmoreira on Tuesday April 07, 2026 @07:27PM (#47682643)
Wow. Mythos must be insanely good considering how good a model Opus already is. I hope it's usable on a humble subscription...
Re:System Card: Claude Mythos Preview [pdf] by crimsoneer on Wednesday April 08, 2026 @04:04AM (#47686910)
You get a single call a month. Use it wisely.
Re:System Card: Claude Mythos Preview [pdf] by FridgeSeal on Wednesday April 08, 2026 @08:03AM (#47689043)
What is the meaning of life, the universe, and everything?

> Thought for 7.5 million years

Re:System Card: Claude Mythos Preview [pdf] by matheusmoreira on Wednesday April 08, 2026 @08:43AM (#47689407)
Hello, Claude!

> Rate limit reached

Re:System Card: Claude Mythos Preview [pdf] by cesarvarela on Wednesday April 08, 2026 @12:26AM (#47685230)
I thought they were bluffing when they talked about the scaling laws, but looking at the benchmark scores, they were not.

I wonder if misalignment correlates with higher scores.

Re:System Card: Claude Mythos Preview [pdf] by maplethorpe on Wednesday April 08, 2026 @04:43AM (#47687194)
Funny, I made my own model at home and got even higher scores than these. I'm a bit concerned about releasing it, though, so I'm just going to keep it local for now.
Re:System Card: Claude Mythos Preview [pdf] by casey2 on Wednesday April 08, 2026 @06:14PM (#47696979)
Lots of benchmaxxing here. A few simple randomizations puts it back on par with gemini 3.1 and under 5.4 pro in most benchmarks
Re:System Card: Claude Mythos Preview [pdf] by mik09 on Wednesday April 08, 2026 @08:47PM (#47698015)
it might have broken a couple metrics since if you get above 90 percent it might be that the metric can not measure you well anymore right?