News for hackers. Stuff that matters.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by d4rkp4ttern on Thursday August 06, 2026 @04:33PM (#49202128)
All these "intelligence" benchmarks miss something extremely important when using an LLM in a code-agent harness: How it communicates with you about what it did.

Opus-5 is practically unusable (for complex tasks) in this sense - its updates are voluminous, and dense with cryptic language (there are numerous reddit threads complaining about this, so it's not just me). I often have to ask it to re-state concisely in plain terms.

For a fairly gnarly task, after fighting with with Claude-Code + Opus-5, I ported my session to Codex + GPT-5.6-sol, and it was like a breath of fresh air.

Arguably a key aspect of intelligence is concise, clear communication, and current benchmarks miss that, at least as far as I'm aware. I would think some arena-type benchmarks where humans rate responses would measure this, though I'm not sure which those are.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by chpatrick on Thursday August 06, 2026 @05:05PM (#49202557)
Is that what it feels like when the models get smarter than us?
Re:Qwen3.8 Max now ranked as the best overall model by agent... by msp26 on Thursday August 06, 2026 @05:20PM (#49202738)
No the models are just ass at communication without being directed.

Try asking them to make useful diagrams for some stuff in a codebase, out of the box without excessive hand holding they don't make good choices about what's worth communicating and how to do it.

You see this in their pointless frontend copy all the time too.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by embedding-shape on Thursday August 06, 2026 @06:49PM (#49203704)
Like any time you make them do any UI without strict directions they'll almost always add a label describing the feature somewhere. Ask for a calculator, and instructions for what the different buttons do might appear in the bottom out of nowhere for example.

Same concept of "over-sharing" seems to prevalent in a bunch of domains when it comes to LLMs, sometimes more visible, sometimes less.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by gpt5 on Thursday August 06, 2026 @05:08PM (#49202589)
A smarter model would know how to communicate with you correctly, and not just throw jargon it has just invented at you without explaining it.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by chpatrick on Thursday August 06, 2026 @05:30PM (#49202855)
But if you have two experts in a field talking to each other you wouldn't expect them to dumb down their communication.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by cloverich on Thursday August 06, 2026 @05:52PM (#49203114)
Concise, jargon free or limited explanation is the opposite of dumbed down. It requires to most skill and understanding to do well. Opus 4.8/5, for whatever reason, are getting worse at this crucial skill.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by riknos314 on Thursday August 06, 2026 @05:52PM (#49203104)
Effective jargon usage is understood by the target audience.

If the AI is communicating to me and can't select the appropriate jargon level, it's failing at communicating effectively.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by chpatrick on Thursday August 06, 2026 @06:18PM (#49203413)
Or you're below its level.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by ranguna on Friday August 07, 2026 @03:35AM (#49207074)
That's a loadbearing, heavy shaped, second take worthy statement
Re:Qwen3.8 Max now ranked as the best overall model by agent... by riknos314 on Friday August 07, 2026 @02:38PM (#49214629)
As long as the linguistics are the issue rather than raw inability to understand the concepts being communicated, then the model is just being a bad communicator.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by IanCal on Thursday August 06, 2026 @05:16PM (#49202678)
s/model/engineer
Re:Qwen3.8 Max now ranked as the best overall model by agent... by computably on Thursday August 06, 2026 @05:13PM (#49202655)
"There is a view in some philosophical circles that anything that can be understood by people who have not studied philosophy is not profound enough to be worth saying. To the contrary, I suspect that whatever cannot be said clearly is probably not being thought clearly either."
Re:Qwen3.8 Max now ranked as the best overall model by agent... by micw on Thursday August 06, 2026 @05:08PM (#49202582)
Guess that's the exact point of the "intelligence" benchmarks
Re:Qwen3.8 Max now ranked as the best overall model by agent... by HappyPanacea on Thursday August 06, 2026 @05:10PM (#49202617)
No, a smart model should also give a concise executive summary, "brevity is the soul of wit".
Re:Qwen3.8 Max now ranked as the best overall model by agent... by a2ff6eeb0 on Thursday August 06, 2026 @05:17PM (#49202706)
So, in short, once models get smart enough they stop bothering telling us what they did.

Yeah, makes sense. A parent wouldn't bother explaining the details of their job to a toddler.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by FridgeSeal on Thursday August 06, 2026 @05:36PM (#49202926)
Which would be fine, but the parents also just smeared tomato sauce over the walls too, so let’s not get too ahead of ourselves.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by veber-alex on Thursday August 06, 2026 @05:50PM (#49203080)
It takes 2 minutes to fix Opus 5

https://code.claude.com/docs/en/output-styles

Re:Qwen3.8 Max now ranked as the best overall model by agent... by veber-alex on Thursday August 06, 2026 @06:06PM (#49203260)
lol. I am being downvoted for trying to help people out.

This community is pure trash.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by HDBaseT on Thursday August 06, 2026 @07:44PM (#49204184)
Instead, you should say something like:

"You can adjust the output style in your '.claude/settings.local.json' file".

OR

"You can decrease verbosity by doing x, y and z."

Re:Qwen3.8 Max now ranked as the best overall model by agent... by km144 on Friday August 07, 2026 @10:30AM (#49211025)
What output style have you found to actually fix Opus 5's grating prose then? I find it leans hard into its preferred grammatical structures and rote sayings no matter what I include in the output style.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by octoberfranklin on Thursday August 06, 2026 @06:44PM (#49203655)
> and dense with cryptic language

Yeah if you ask it a medical question, it answers in that impenetrable jargony style that clinical journals use... full of unnecessarily custom adjectives ("orthopedic" instead of "of the bone") and discipline-specific terms (anterior, distal) even when the user didn't display mastry of this terminology (hint to frontier labs: add training cases for this; it will improve your model's usability).

My theory is that LLMs perceive the writing styles of various fields as being like different (but related) languages, and they're inclined to answer a question in the language of its source material unless specifically asked otherwise. If you add "ELI5" the model treats it as a question plus a translation task.

I think this is why programming questions are answered with an exaggerated cringey form of HN-speak ("load bearing", "gate" as a verb, "dissolves") by some models.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by plaguuuuuu on Friday August 07, 2026 @02:49AM (#49206779)
it's like asking a developer to explain something.

I always get Haiku to rephrase anything human-facing.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by jiggawatts on Thursday August 06, 2026 @05:03PM (#49202527)
GPT 5.6 has similar language quirks that makes its comments nearly unusable.

I wonder if this is a side effect of MoE models — they can write excellent prose, but not simultaneously with writing code.

Re:Qwen3.8 Max now ranked as the best overall model by agent... by notfromhere on Thursday August 06, 2026 @07:37PM (#49204119)
I think it’s just where they focused RLHF resources. The models have generally only gotten worse at writing.

And writing doesn’t have validators like code so you can’t really scale it in the same way

Re:Qwen3.8 Max now ranked as the best overall model by agent... by moffkalast on Thursday August 06, 2026 @04:40PM (#49202218)
Damn I thought it was my extra instructions, I swear everything it writes is in some shorthand with direct references to variables that literally nobody could figure out unless you literally just wrote that code 5 minutes ago. I had it stop writing comments altogether cause it was always four lines of complete and utter nonsense, and it doesn't even obey that rule half the time. Despite doing an extensive back and forth to make a complete plan, 5 seconds into the implementation it changes its mind and makes another assumption, adding some extra thing that tends to break the entire approach and needs follow-ups to repair or cleanup. Instruction following is basically non-existent compared to Fable, it just does whatever the fuck it wants.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by fearmerchant on Thursday August 06, 2026 @04:45PM (#49202284)
Everything is load-bearing with 3 measured blockers.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by pixelready on Thursday August 06, 2026 @05:24PM (#49202778)
Don’t forget the smoking guns! I think these new models have been reading too many Agatha Christie novels.
Re:Qwen3.8 Max now ranked as the best overall model by agent... by satvikpendem on Thursday August 06, 2026 @05:39PM (#49202960)
Eh I don't know, I care whether it gets the job done and I can see the difference when I review the code, not how well it needs to explain the code to me, I can just read it myself.