News for hackers. Stuff that matters.
Re:GPT‑6.2 Astra and Sol by intenex on Tuesday November 17, 2026 @12:54PM (#50535369)
Performance is insane for the cost if those benchmarks hold up. Looks like they did time this for right before Anthropic's IPO. Curious what Anthropic releases in response, and how these do on real world tasks.

Feels like we're way past the pelican benchmark being useful at this point. Anyone have a better benchmark for a quick vibe check on how this compares to Fable 5.2 and Opus 5.5?

Re:GPT‑6.2 Astra and Sol by ijustlovemath on Tuesday November 17, 2026 @01:00PM (#50535451)
I've been having fun with having it build interactive Three.js demos of devices, with setup screen, a few different operational modes, mechanical movements etc
Re:GPT‑6.2 Astra and Sol by IAmGraydon on Tuesday November 17, 2026 @02:56PM (#50537223)
Can we see a demo? There's a threejs subreddit that is absolutely overflowing with impressive LLM generated demos, in case you haven't seen it:

https://www.reddit.com/r/threejs/

Re:GPT‑6.2 Astra and Sol by alastairr on Tuesday November 17, 2026 @01:03PM (#50535503)
I didn't find Sol 6.1 nearly as impressive in real SWE use compared to what the benchmarks implied. It wouldn't surprise me if the models have internalised some kind of 'benchmarking mode' which only kicks in when some attributes that are peculiar to how benchmark problems are presented.
Re:GPT‑6.2 Astra and Sol by suddenlybananas on Tuesday November 17, 2026 @01:06PM (#50535554)
You make it sound as though the models are like not working to their full potential instead of being a little bit overfit on the benchmarks.
Re:GPT‑6.2 Astra and Sol by pkthunder on Tuesday November 17, 2026 @01:07PM (#50535573)
We've recently moved away from Anthropic models at $PAID_JOB and over towards GPT models. I'm trying to be open-minded but the GPT models we have (5.6 Terra and Sol) are just not that great. They're fine, but even simple things such as "check my work on this small Bash function" get it to point out stuff that's already implemented in my work. I don't know if it's me/how I use it/whatever, but just some N=1 evidence, I guess.
Re:GPT‑6.2 Astra and Sol by ok_dad on Tuesday November 17, 2026 @01:13PM (#50535685)
5.6 series is worse and more expensive than the 6 series. Try the latest Luna and sol; I use those for 100% of my work right now, with sol doing only 10-5 percent of it. I code in go and review the work and edit it extensively though, so I don’t know about how good those two are at vibing slop.
Re:GPT‑6.2 Astra and Sol by krzyk on Tuesday November 17, 2026 @01:23PM (#50535850)
5.6 was better than 6. 6.1 is a bit better than 5.6 from my tests
Re:GPT‑6.2 Astra and Sol by drdexebtjl on Tuesday November 17, 2026 @01:14PM (#50535706)
[delayed]
Re:GPT‑6.2 Astra and Sol by Doohickey-d on Tuesday November 17, 2026 @01:16PM (#50535751)
Well, yes, if you switch from current claude model to something that was released in July, of course it will be worse...
Re:GPT‑6.2 Astra and Sol by zachthewf on Tuesday November 17, 2026 @01:20PM (#50535804)
why do you guys have to use 5.6?
Re:GPT‑6.2 Astra and Sol by Den_VR on Tuesday November 17, 2026 @01:31PM (#50535991)
IYKYK. But in short because of a lack of alignment with product strategy
Re:GPT‑6.2 Astra and Sol by pkthunder on Tuesday November 17, 2026 @01:58PM (#50536415)
DOD limitations
Re:GPT‑6.2 Astra and Sol by quotemstr on Tuesday November 17, 2026 @02:07PM (#50536551)
The BOFH "IT admin" type of guy, an eternal scourge on the industry, has moved from delaying approvals of software you need to delaying approvals of updated models. It's management job to make sure these people don't burrow themselves into gatekeeping roles at an organization's expense
Re:GPT‑6.2 Astra and Sol by Tarq0n on Tuesday November 17, 2026 @02:33PM (#50536927)
I believe that's all you get in copilot (365) basic.
Re:GPT‑6.2 Astra and Sol by InsideOutSanta on Tuesday November 17, 2026 @01:26PM (#50535906)
5.6 is in no way representative, or comparable to 6.1. In fact, the 6.1 models are so good that I've just used Terra 6.1 xhigh for most tasks.
Re:GPT‑6.2 Astra and Sol by mi_lk on Tuesday November 17, 2026 @01:36PM (#50536059)
sol 6.1 is meh
Re:GPT‑6.2 Astra and Sol by SOLAR_FIELDS on Tuesday November 17, 2026 @01:42PM (#50536156)
GPT models in my anecdotal experience are worse at drifting into the weeds on long running tasks, and continue to take what you ask way too literally. I have come to the conclusion that Anthropic’s models are just better at teasing out and intuiting what you actually mean even if you under specify it.

They are much better compute for dollar though. I have hilariously started to just have an opus thread maintain Sol subagents to get the best of both worlds

Re:GPT‑6.2 Astra and Sol by jpardoe on Tuesday November 17, 2026 @01:52PM (#50536326)
That’s exactly what I do. I have about 8 different sub agents in total but vaguely: Opus medium as orchestrator and reviewer, Sol(high/medium)/Terra(max) as implementer. My set up looks at my next GPT reset date and dynamically enters FAST mode if I’m under achieving on projected usage.
Re:GPT‑6.2 Astra and Sol by ctbellmar on Tuesday November 17, 2026 @01:53PM (#50536344)
Similar experience here. The spirals on long running tasks are out of control at times with hours going by without a conclusion.
Re:GPT‑6.2 Astra and Sol by SOLAR_FIELDS on Tuesday November 17, 2026 @01:55PM (#50536381)
They (OpenAI models) are very tuned to be depth first and you can coach them all you want to try to be breadth first but as that context window fills up on those long running tasks they drift back to their first principles, which means obsessively testing and verifying a singular task rather than proceeding to the next task on the list
Re:GPT‑6.2 Astra and Sol by quotemstr on Tuesday November 17, 2026 @02:06PM (#50536528)
If you're using a sufficiently flexible harness (perhaps your own) you can make conversations as branchy as you want.
Re:GPT‑6.2 Astra and Sol by nsingh2 on Tuesday November 17, 2026 @02:28PM (#50536859)
I wonder if that depth-first/rabbit-holing tendency is why GPT models tend to be better at mathematics (my own experience) than code.
Re:GPT‑6.2 Astra and Sol by Sharlin on Tuesday November 17, 2026 @02:44PM (#50537095)
I’m not sure. It’s very easy to get lost deep in a wrong branch when you’re trying to solve a math problem. You have to intuit when to give up and backtrack, lest you end up going in circles.
Re:GPT‑6.2 Astra and Sol by sandos on Tuesday November 17, 2026 @02:35PM (#50536946)
This explains why I like GPT: I LIKE for them to excessively test each step, kthx!
Re:GPT‑6.2 Astra and Sol by throwitaway222 on Tuesday November 17, 2026 @01:36PM (#50536063)
Bro you have to be at 6+. 5.6 is EARLY JULY
Re:GPT‑6.2 Astra and Sol by wahnfrieden on Tuesday November 17, 2026 @01:48PM (#50536270)
5.6?? How is your impression of 5.6 relevant to anything recently?
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @01:07PM (#50535587)
Yeah, in real SWE tasks, 6.1 is bad.

We've been trying to capture real SWE data by building a battle system on top of OpenCode. In our data, Sol 6.1 is seriously underperforming, I'm talking worse than DeepSeek 4.1 Flash, at 10x the cost. (We allow votes before both agents are done, contrary to typical Arena methodology, because we think a fast good enough answer is better than a slow one. https://agentduel.com/leaderboard).

OpenAI performance on our system has been bad enough I switched to Anthropic models for my daily work.

Re:GPT‑6.2 Astra and Sol by slekker on Tuesday November 17, 2026 @01:24PM (#50535870)
Is this an ad?
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @01:28PM (#50535938)
No. I'm personally building agentduel.com, specifically with this problem in mind (benchmark performance not matching real world usage). It's generally accepted by HN community to make relevant comments about your own projects, as long as its not hamfisted.
Re:GPT‑6.2 Astra and Sol by WarmWash on Tuesday November 17, 2026 @02:20PM (#50536736)
Using non-native harnesses sort of throws a wrench in things. I pretty sure your benchmark would look much different if outputs came from their intended harness.
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @02:39PM (#50537015)
[delayed]
Re:GPT‑6.2 Astra and Sol by arcanemachiner on Tuesday November 17, 2026 @02:20PM (#50536743)
It certainly does get tiresome though.
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @02:37PM (#50536980)
Certainly does. See my comment here roasting this extremely BS blog post that is basically an ad: https://news.ycombinator.com/item?id=50532191.

Do my comments get tiresome, though? None have been downvoted to hell, since they are all adding to discussion. If you think so feel free to email me, I don't want to be annoying.

Re:GPT‑6.2 Astra and Sol by igravious on Tuesday November 17, 2026 @02:33PM (#50536925)
Yeah, maybe one thread per article will do?, otherwise it comes across as shilling
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @02:38PM (#50536993)
Fair enough, though all the comments have either 1pt or positive karma, so I take that as a signal that they're adding value so far. I'll take a coffee break, though, hah.

Genuinely, just excited about what we're building and think it adds information about these models that are missing.

Re:GPT‑6.2 Astra and Sol by arcanemachiner on Tuesday November 17, 2026 @02:19PM (#50536734)
Welcome to HN.

BTW check out my totally real project that helps you detect native advertising on your favorite platforms:

https://github.com/blah/blah

Re:GPT‑6.2 Astra and Sol by techpression on Tuesday November 17, 2026 @02:38PM (#50536990)
I get 404, a lost sale!
Re:GPT‑6.2 Astra and Sol by locusofself on Tuesday November 17, 2026 @01:27PM (#50535917)
I've been building quite a complex desktop app (a digital audio workstation) using 6.1 Sol and it's been very good for me
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @01:57PM (#50536398)
Yeah, our data only has 28 battles tagged "desktop":

Web: 87 (12.2%) Systems and protocols: 78 (10.9%) Software, unspecified type: 74 (10.4%) Backend: 68 (9.5%) Writing and documentation: 55 (7.7%) Research and advice: 47 (6.6%) Unknown: 42 (5.9%) Mobile: 40 (5.6%) Operations and automation: 36 (5.0%) Developer tooling: 35 (4.9%) Desktop: 28 (3.9%) Media and design: 27 (3.8%) Data analysis: 25 (3.5%) Device and system support: 22 (3.1%) Math and formal methods: 18 (2.5%) Games and simulations: 15 (2.1%) Infrastructure and DevOps: 9 (1.3%) AI and machine learning: 6 (0.8%) Other: 1 (0.1%)

Re:GPT‑6.2 Astra and Sol by aatd86 on Tuesday November 17, 2026 @02:19PM (#50536722)
Yeah my main models are OpenAIs... I am trying Opus right now because I dont have any credit anymore but from experience, it was never as thorough as openai's models. It can be genius and unblock at times, but I've never been able to trust it.
Re:GPT‑6.2 Astra and Sol by throwitaway222 on Tuesday November 17, 2026 @01:50PM (#50536302)
I'm guessing you don't use codex though- the harness + model combo makes a difference.
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @02:12PM (#50536623)
There was a post about that today on HN but it looks largely to be bogus. I wrote a blog post about it, but not linking here to avoid too much self promotion in this thread. Funny enough my conclusion was that OpenAI models seem to be the only ones that actually do have an own-harness interaction, hah.
Re:GPT‑6.2 Astra and Sol by skerit on Tuesday November 17, 2026 @01:09PM (#50535614)
I had the same impression. None of the GPT-6 models were as great as they claimed, they never surpassed Fable or Opus 5.5 on my use-cases.
Re:GPT‑6.2 Astra and Sol by Corence on Tuesday November 17, 2026 @01:23PM (#50535861)
Yeah, MaxxBench was shared here a while ago and showed most models think about how a grader will evaluate their work on DeepSWE in 95%+ of traces. Strong models definitely realize they're being graded and start to game their output.

https://maxxbench.unlap.ai/research/why-maxxbench/

Re:GPT‑6.2 Astra and Sol by aleqs on Tuesday November 17, 2026 @02:14PM (#50536653)
We know anthropic nerfs models all the time, openai probably does the same. There is no reason to believe the benchmarks/numbers they release are even measured with the same effective model that customers would get.
Re:GPT‑6.2 Astra and Sol by hugmynutus on Tuesday November 17, 2026 @02:34PM (#50536935)
Sol-6.1 made me cancel my OpenAI subscription. Sol-5.X was bad, then 6 was barely an upgrade. Then 6.1 came out and it didn't move the bar. Went back to Anthropic.

General, SWE, python development, rust development, tool use. It is 'perfectly functional' and if you don't care about the model following your instructions or code quality it is 'fine'.

Re:GPT‑6.2 Astra and Sol by varispeed on Tuesday November 17, 2026 @02:40PM (#50537040)
I wonder if these companies do selective scamming. For me Fable, Opus are unusable. They are completely dumb. I consider downgrading or cancelling subscription. Whereas Sol 6.1 got me my jaw dropped. Reminded me of Opus 4.6 before it got nerfed. It's so good I completely cancelled my Cursor subscription and uninstalled it.
Re:GPT‑6.2 Astra and Sol by lnrd on Tuesday November 17, 2026 @02:42PM (#50537061)
Been using only Sol 6.1 on high/extra daily at my SWE job since it came out (with its official harness). It can basically do everything I need it to do. I still review its code and generally I have to leave around 10/20 comments in a ~700 line PR, flagging things it missed or weird decision. One or two iterations are enough to fix everything. Its still way faster than doing it myself, unfortunately.
Re:GPT‑6.2 Astra and Sol by tezza on Tuesday November 17, 2026 @02:43PM (#50537075)
I review LLMS, and 6.1 sol is fantastic.

What kind of stuff were you throwing at it and where was it letting you down.

So what have I been doing with, then? It’s done a great job for me

I’ve got 6.1-sol to take an Amiga driving game binary and add networked car driving into a web enabled Amiga emulator… that’s interpreting machine code, Amiga architecture and then making meaningful changes.

So yeah, 6.1-sol is good.

Re:GPT‑6.2 Astra and Sol by hrncn on Tuesday November 17, 2026 @02:52PM (#50537172)
I am not even certain 6.1 sol is better than 5.6 sol after using both for some time now, so not expecting much here.. but then again, 6.0 sol was completely useless, so maybe the .1 bump means something here.
Re:GPT‑6.2 Astra and Sol by revolvingthrow on Tuesday November 17, 2026 @01:11PM (#50535652)
> Looks like they did time this for right before Anthropic's IPO.

Would it be in OAI's interest to kick the legs from under Anthropic? Granted I don't think they can, but a shot across the bow can sometimes be more damaging that one expects (I think FTX collapsed due to one? Or maybe I'm misremembering).

I always assumed that if one of the big AI IPOs fail hard enough the neoclouds start to go bust, which causes a chain reaction that probably causes both ANT and OAI to collapse.

Re:GPT‑6.2 Astra and Sol by arscan on Tuesday November 17, 2026 @01:34PM (#50536033)
My reaction as well - at the very least now is probably not the best time to knock down the realized valuation of a peer when they are effectively setting the market value of the whole category of ai companies, including yours… right?
Re:GPT‑6.2 Astra and Sol by kridsdale3 on Tuesday November 17, 2026 @02:04PM (#50536503)
I guess it's a good idea for them to wreck the appeal for their own employees to leave for the competitor.
Re:GPT‑6.2 Astra and Sol by AlexCoventry on Tuesday November 17, 2026 @02:26PM (#50536831)
https://nitter.netbub.com/mattshumer_/status/212276041577177...

> I have no idea why they released this. It needed a lot more iteration.

Maybe the goal is to make Anthropic's models look good by comparison. :-)

Re:GPT‑6.2 Astra and Sol by karimf on Tuesday November 17, 2026 @01:18PM (#50535773)
I'm very curious on this as well.

Recursive self-improvement (RSI) has been a very hot topic recently, and it could be the biggest factor that decide Anthropic's IPO.

I wonder if the general public can infer whether RSI has started based on the recent performance gain of the frontier model.

Re:GPT‑6.2 Astra and Sol by ppierre on Tuesday November 17, 2026 @01:37PM (#50536082)
Yeah we see some Really Stupide Intervention from those who drank the Kool aid. IAS2[] start to be a real thing.

[] IA Stockholm Syndrome.

Re:GPT‑6.2 Astra and Sol by antupis on Tuesday November 17, 2026 @01:38PM (#50536094)
Why IPO if you have RSI and possible ASI?
Re:GPT‑6.2 Astra and Sol by esafak on Tuesday November 17, 2026 @01:40PM (#50536131)
So investors can cash out on the time frame they promised investors.
Re:GPT‑6.2 Astra and Sol by AlexCoventry on Tuesday November 17, 2026 @01:57PM (#50536395)
So you can scale up. RSI is going to be compute-bound. ML experiments cost compute. Also, if you can make a genius in a data center, why not make a hundred/a million geniuses?
Re:GPT‑6.2 Astra and Sol by HarHarVeryFunny on Tuesday November 17, 2026 @01:50PM (#50536289)
RSI just means using the LLM as part of the development process, which they are already doing. I doubt any of these companies are going to fire all their developers, so there is no point development is going to be 100% automated - for the foreseeable future it will always be a mix of humans using LLMs.

So, you can say they are doing "RSI" (aka using tools to automate development) already, and will continue to do so.

Re:GPT‑6.2 Astra and Sol by ranyume on Tuesday November 17, 2026 @01:26PM (#50535912)
You're looking for a vibe check?
Re:GPT‑6.2 Astra and Sol by the_duke on Tuesday November 17, 2026 @01:29PM (#50535964)
> Looks like they did time this for right before Anthropic's IPO.

While both Anthropic and OpenAI have been playing games with model announcement timings, this time I don't think it's related.

These are incremental bumps, not big new models that have a huge impact.

Re:GPT‑6.2 Astra and Sol by mlinsey on Tuesday November 17, 2026 @01:30PM (#50535975)
If you have the quota or budget for it, I recommend vibe-coding your own personal benchmark. I have a suite of 8 projects that I made with models this year, and replay them - give the new model a checkout of the repo at that point, and the project spec. For the design task, I have it throw up a blind voting page for me to quickly judge, and for implementation I have a review agent do a general score and also hunt for problems/edge cases that I really found.

It's a lot more imprecise than the public benchmarks, but it's tailored to my own work and definitely isn't being benchmaxxed by the model developers. I was able to tell really quickly that Opus 5.5 delivered on the hype, and that some other releases (a couple of the more recent open releases, and pre-Carbon gemini models) were not as good for me as public benchmarks made them look.

(no results for either 6.2 yet, will take another ~6-8 hours, but I encourage people reading this with spare tokens to just make their own like I did instead of listen to me)

Re:GPT‑6.2 Astra and Sol by grey-area on Tuesday November 17, 2026 @01:33PM (#50536020)
This is much more interesting IMO than any public benchmark. They are definitely targeting those benchmarks and model capability does seem to have plateaued somewhat.
Re:GPT‑6.2 Astra and Sol by srcreigh on Tuesday November 17, 2026 @01:36PM (#50536061)
please update !
Re:GPT‑6.2 Astra and Sol by Havoc on Tuesday November 17, 2026 @01:38PM (#50536090)
What type of tasks did you use for this? Evaluation?

Last time I did this I found it quite hard to come up with tasks that have clear evaluation outcomes

Re:GPT‑6.2 Astra and Sol by bertmuir on Tuesday November 17, 2026 @01:54PM (#50536366)
[delayed]
Re:GPT‑6.2 Astra and Sol by khimaros on Tuesday November 17, 2026 @02:37PM (#50536984)
Re:GPT‑6.2 Astra and Sol by seizethecheese on Tuesday November 17, 2026 @01:54PM (#50536369)
[delayed]
Re:GPT‑6.2 Astra and Sol by behat on Tuesday November 17, 2026 @02:03PM (#50536490)
This is great, and I have been setting up infra to do this very thing. How many sessions to you replay typically to get a reasonably confident estimate? Assuming each project in your suite was built over multiple sessions.
Re:GPT‑6.2 Astra and Sol by eli on Tuesday November 17, 2026 @02:52PM (#50537175)
I have built my own benchmarks and it's very valuable to have them but I'm skeptical you can get good results vibe coding them.

Getting the framework right isn't that hard, but requires some careful thought. You probably don't want to just checkout a repo at a certain commit hash - agents will explore other commits and branches. (Public repos are also risky in general: agents with internet access can find later commits, and public repos could be in the training data anyway.) I use `git archive` and give the runner just the files at that commit and nothing else. I also do the run inside an isolated container that is recreated each run so it can't find e.g. related files left in /tmp from a previous run.

Getting the benchmark tasks right is harder. I don't think there's any way to get around writing the task and its evaluation by hand. I really tried to get a few different frontier LLMs to do it and they're all terrible at "imagining" what an agent would need to solve a problem without giving away the answer or providing too little information. Also quite bad at writing evaluation criteria that tests whether the solution matches the assignment (versus just how close it is to a golden solution, or how close it is to how they would solve it)

I personally don't like or trust using LLM as a grader either, but I guess people manage to get that to work well enough.

Re:GPT‑6.2 Astra and Sol by behnamoh on Tuesday November 17, 2026 @01:39PM (#50536122)
> Feels like we're way past the pelican benchmark being useful at this point.

It was neither a benchmark nor a good one at that. Just a blogger's curiosity that grew out of control.

Re:GPT‑6.2 Astra and Sol by xtracto on Tuesday November 17, 2026 @01:43PM (#50536169)
>Feels like we're way past the pelican benchmark being useful at this point. Anyone have a better benchmark for a quick vibe check on how this compares to Fable 5.2 and Opus 5.5?

Generate an SVG with complete and detailed graphical instructions on how to fold an origami pelican riding a bicycle

(or any other complex origami object). The fact that it has to teach [you] something makes it pretty interesting.

Re:GPT‑6.2 Astra and Sol by 6thbit on Tuesday November 17, 2026 @01:44PM (#50536177)
They're going after anthropic's market through cheaper intelligence per token.

I wouldn't be surprised if they released 6.2 luna with the most attractive positioning on the pareto frontier right as the IPO happens.

Re:GPT‑6.2 Astra and Sol by stbenjam on Tuesday November 17, 2026 @01:56PM (#50536390)
My vibe bench is no dependency HTML bowls of ramen https://bitbin.de/ramen-bench/

Opus 5.5 Max is my favorite.

6.2 are running, will be up later

Re:GPT‑6.2 Astra and Sol by dava96 on Tuesday November 17, 2026 @02:00PM (#50536441)
just a fyi this crashed my browser
Re:GPT‑6.2 Astra and Sol by kridsdale3 on Tuesday November 17, 2026 @02:04PM (#50536514)
data point: no trouble seeing it on Chrome on MacOS (whatever the last one before the liquid glass update) on M5.
Re:GPT‑6.2 Astra and Sol by NiloCK on Tuesday November 17, 2026 @02:03PM (#50536487)
Seconded.
Re:GPT‑6.2 Astra and Sol by stbenjam on Tuesday November 17, 2026 @02:05PM (#50536523)
Which browser / version / os? Works fine for me on Chrome and Safari
Re:GPT‑6.2 Astra and Sol by letmevoteplease on Tuesday November 17, 2026 @02:27PM (#50536837)
Doesn't crash my browser but Gemini 4 Carbon High freezes up the page. The others run fine.

I thought it was interesting that all the Sonnet 5.5 have a weird light effect on the bowl. XHigh has a nice film grain too.

Re:GPT‑6.2 Astra and Sol by stbenjam on Tuesday November 17, 2026 @02:34PM (#50536934)
TY I'll put it behind a warning
Re:GPT‑6.2 Astra and Sol by Pxtl on Tuesday November 17, 2026 @02:16PM (#50536688)
Poking around models crashed the tab in Firefox on windows.
Re:GPT‑6.2 Astra and Sol by fullstackchris on Tuesday November 17, 2026 @02:20PM (#50536744)
Wild. The opus ones literally look photo realistic... (Want to declare I am NOT a payed anthropic spammer, but look at those for yourself)

Also confirms grok is absolute garbage

Re:GPT‑6.2 Astra and Sol by stbenjam on Tuesday November 17, 2026 @02:22PM (#50536770)
Yep, seeing Opus results convinced me that maybe Anthropic is right on not neeeding an image gen model. It was very slow though.
Re:GPT‑6.2 Astra and Sol by crimsoneer on Tuesday November 17, 2026 @01:58PM (#50536421)
I'm just running it on my Blood Bowl Bench, holding it's own against the reigning champ Argon so far but early days...

https://botbowlbench.com/

Re:GPT‑6.2 Astra and Sol by i_have_an_idea on Tuesday November 17, 2026 @02:04PM (#50536504)
An Anthropic shareholder is very negative about a Anthropic-beating model release, right before the Anthropic IPO? Interesting, yes.
Re:GPT‑6.2 Astra and Sol by platinumrad on Tuesday November 17, 2026 @02:05PM (#50536526)
Shumer is a known scammer (Reflection 70B, among other things). Why does he have any credibility?
Re:GPT‑6.2 Astra and Sol by wilkystyle on Tuesday November 17, 2026 @02:20PM (#50536737)
Not to mention he didn't actually provide any reason why the models are bad. When pressed in the comments and asked what was bad, he said "everything"...
Re:GPT‑6.2 Astra and Sol by user43928 on Tuesday November 17, 2026 @02:45PM (#50537100)
I saw another review from an early tester saying it's the worst model ever to work with.

The review claimed that the writing in the output is incomprehensible.

It also said that with /goal, the model set the goal to blocked to ask for the filename reporter_3423 should write to.

Lastly the reviewer said it made no progress on a large project.

Re:GPT‑6.2 Astra and Sol by tiborsaas on Tuesday November 17, 2026 @02:20PM (#50536751)
Anybody who says stuff like "They were essentially unusable." without any context or proof is going to my permaban on credibility. Even 1 year old models are perfectly usable let alone frontier ones.
Re:GPT‑6.2 Astra and Sol by aswegs8 on Tuesday November 17, 2026 @02:41PM (#50537054)
That's what I thought. "Interesting negative vibe check". I open X, it's someone just saying they're unusable. Why is this top comment?
Re:GPT‑6.2 Astra and Sol by throwaway384034 on Tuesday November 17, 2026 @02:29PM (#50536874)
Using your top comment to edit in something like that on a big release should be treated as bad faith. Comment should be deranked.
Re:GPT‑6.2 Astra and Sol by aleqs on Tuesday November 17, 2026 @02:12PM (#50536630)
None of these benchmarks/marketing numbers from openai or anthropic have ever held up.

Now that we know anthropic nerfs models after release, and without any notice/openess, there is no reason to even think these benchmarks they release are even done with the same model/intelligence that actual customers would get.

Re:GPT‑6.2 Astra and Sol by bob1029 on Tuesday November 17, 2026 @02:17PM (#50536697)
gpt-6.1-terra is already beyond end game for my client's business. They don't require anything more powerful.

Cost is the most important factor now.

Re:GPT‑6.2 Astra and Sol by teknologist on Tuesday November 17, 2026 @02:19PM (#50536733)
Beware of the paid influencers who don't disclose their affiliations in this space. Theo is another one who now talks smack about anything that isn't Claude. They bend reality to fit a narrative.
Re:GPT‑6.2 Astra and Sol by Thrombocius on Tuesday November 17, 2026 @02:34PM (#50536941)
Thoroughbench Fireship’s horse animation test is actually a pretty nice vibe check.
Re:GPT‑6.2 Astra and Sol by kylehotchkiss on Tuesday November 17, 2026 @02:39PM (#50537018)
Sincerely curious: why do people feel led to use the word "insane" to describe every new model release? I just don't understand what about incremental improvements needs to elict such a strong response.

We knew that improvements would continue to roll out increimentally, the costs would go down, we watched Moores law for decades before this?

Re:GPT‑6.2 Astra and Sol by giancarlostoro on Tuesday November 17, 2026 @02:42PM (#50537068)
Well, Fable also went down in cost too in their last update to Fable, and honestly, if they released a crazy new model on IPO day it wouldn't surprise me. Save the best for an impressive IPO.