News for hackers. Stuff that matters.
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by rootusrootus on Wednesday November 18, 2026 @08:15PM (#50554778)
I guess what I really want to know is how Gemini 4 Neon w/Antigravity compares with Opus 5.5/Claude Code. I'm not really into using LLMs in a particularly advanced way, I just use CC like 99% of the time when I need to write something, and then maybe Codex to second guess it.

But that's about as complicated as I get. I have recently tried to use Copilot because that is what work wants us to use, and even with Opus 5.5 it is noticeably inferior to CC on the same model. Wild. So clearly the harness matters.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by seizethecheese on Wednesday November 18, 2026 @08:21PM (#50554850)
Totally possible for your use case, though the analyses I’ve done on harness model interactions show it’s actually not that important for benchmark performance. https://micjm.com/blog/on-model-harness-interactions/

For what it’s worth, the linked article data (Agent Duel data) is all run on OpenCode. I’m curious if people would prefer we run each model in its native harness (at the expense of user experience because it’ll be buggy).

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by thanhhaimai on Wednesday November 18, 2026 @09:40PM (#50555387)
Harness plays a significant part in benchmarking performance.

Here is an example from FrontierCS bench: https://x.com/wenhaocha1/status/2114559544156205413

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by seizethecheese on Wednesday November 18, 2026 @10:31PM (#50555732)
We can trade posts because I did my own analysis and found almost no effect https://micjm.com/blog/on-model-harness-interactions/
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by thefunnyman on Wednesday November 18, 2026 @08:23PM (#50554870)
We had CC for a while and now have to use GHCP. As such I haven't used CC in like 6 months but around the time I switched I felt like GHCP CLI had pretty much caught up. Curious to hear what you feel are the gaps? Are you using the cli versions of both?
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by rootusrootus on Wednesday November 18, 2026 @08:56PM (#50555124)
Yep, CLI versions for both GHCP and CC. To be honest, I haven't done enough actual coding with GHCP yet to get a feel, so my original comment may be too broad. But I've been repeatedly comparing and contrasting with CC for code reviews (as a team lead, I do more of that these days than coding). I have been pretty consistently getting about half again as many bugs from CC as from GHCP. And very nearly always correct, not hallucinations.

My company is slow-walking (and that is an understatement) our LLM usage, so the majority of work that I'm reviewing is human generated. After the stories I hear of what other people are experiencing when management is more enthusiastic, maybe I should count myself lucky.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by pritambarhate on Wednesday November 18, 2026 @08:26PM (#50554903)
Also last I checked there was no clear flag to turn off training in paid plan of Antigravity. So if you care about that looks like Google doesn’t want you as their customer.
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by riskassessment on Thursday November 19, 2026 @12:20AM (#50556359)
I think you just turn off telemetry in antigravity to disable training. The Gemini app (including the web chatbot) is much more frustrating: the only way to disable training in the Gemini app (for a personal account) is to turn off apps and history.
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by scottyah on Wednesday November 18, 2026 @08:33PM (#50554971)
The models can be very optimized for the harness, Clem (of Hugging Face) just recently released a Qwen3.8 model that used RL training on the harness and it got some pretty significant gains in the benchmarks.

- SWE-bench Pro (hard 51): 39.2% → 64.7%

- Terminal-Bench 2.1: 39.5% → 55.8%

https://huggingface.co/harness-hub/Qwen3.8-27B-pi-adapted

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by seizethecheese on Wednesday November 18, 2026 @08:49PM (#50555083)
I'll call bullshit on that.

If this were true, models would do way better in their own harness than in others, which doesn't seem to be the case (effect is minor).

Your link has a "link to the release blogpost" which is supposed to explain the training recipe but the link is down.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by jdiff on Wednesday November 18, 2026 @09:12PM (#50555211)
Could have an outsized effect on a smaller model.
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by rubyn00bie on Wednesday November 18, 2026 @09:53PM (#50555471)
On a benchmark it might be minor or bullshit, but for me on real projects Claude Code has produced vastly better results than I was getting via Cursor or OpenCode. I used to believe the harness was negligible to having the agent do good work, but now I think it’s essential.

The big “aha” moment for me was seeing the wildly different results I’d get using something like Claude Design vs just prompting (even when using leaked system prompts). I then started hearing about the special harnesses available for biotech, science, and math that seem to be available for researches via OpenAI and Anthropic directly… which sort of further cemented in my brain how important it must be. I wish I got the same quality from Cursor, or OpenCode, as I do Claude but I just don’t.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by anukin on Wednesday November 18, 2026 @08:44PM (#50555048)
Antigravity in general is a poor harness. I have had better experience using Gemini 3.8 flash over api than using it over agy.
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by TacticalCoder on Wednesday November 18, 2026 @09:01PM (#50555157)
Ah that's a new angle. After the "Google models are behind" and the "Google models are slower" and the "Google costs more per tokens", we're now at the following phase:

"OK, google models perform just as well, are faster and are cheaper but all that doesn't matter. Because the models, now that Google has very good ones, doesn't matter after all. All that matters is the harness".

And of course it's upvoted by the Anthropic shills.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by ddxv on Wednesday November 18, 2026 @09:42PM (#50555416)
A lot of this is brand affiliation as well.
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by vrosas on Wednesday November 18, 2026 @10:20PM (#50555645)
Don't forget "I couldn't figure out how to buy a subscription" and "The names are confusing"
Re:Gemini 4 Neon looks like an Opus 5.5 competitor by rootusrootus on Wednesday November 18, 2026 @11:21PM (#50556055)
That's what you got from what I wrote?

I must not be deep enough into the conversation to get it. I was just sharing my own perspective. I don't follow AI development nearly as close as a lot of HN does. I don't hate it, but I don't love it either, it's just part of my job now.

> And of course it's upvoted by the Anthropic shills.

Gotta tell you, my post is barely above water ;-). It goes up, goes right back down, plenty of people seem to agree with you that I'm being mean to Google or something.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by retsibsi on Thursday November 19, 2026 @12:35AM (#50556429)
> "OK, google models perform just as well, are faster and are cheaper but all that doesn't matter. Because the models, now that Google has very good ones, doesn't matter after all. All that matters is the harness".

Have they edited their comment since you replied? If not, this is one of the most egregious strawmen I've seen this week. You have brought a lot of your own baggage to this discussion, and stuffed it into a comment that said approximately none of what you claim to have taken from it.

Re:Gemini 4 Neon looks like an Opus 5.5 competitor by TiredOfLife on Thursday November 19, 2026 @12:27AM (#50556388)
It's really simple. You somehow trigger an account ban for Claude you lose that account and create another one.

You get the same with antigravity and you get your whole Google account banned