News for hackers. Stuff that matters.
Re:OpenAI is well positioned to fast-follow Jev by ACCount39 on Tuesday September 22, 2026 @02:15PM (#49805749)
Or not. And replace the generalist with the next generalist that gets you +15% on that benchmark for the same price, or gives you the same benchmark performance for half the price.

One advantage of using generalist models is that the generalists are improving - regardless of whether you're doing anything about it.

Re:OpenAI is well positioned to fast-follow Jev by firejake308 on Thursday September 24, 2026 @01:45PM (#49834251)
Yes, but the generalists are not routinely improving across all domains. The large labs are really focusing on agentic use, so I imagine that creative writing has deteriorated considering how distinctive Claude's writing style has become. Or I recently had an image-parsing task, and I was excited to try Qwen because I heard it had gotten a lot better at agentic tasks, but it failed my image-parsing benchmark.
Re:OpenAI is well positioned to fast-follow Jev by ACCount39 on Thursday September 24, 2026 @07:54PM (#49838380)
There are focus areas, but capabilities improve across all domains - some slower than others. "Agentic use" is in itself a very general thing - because many tasks benefit from being able to leverage adaptive model-driven workflows.

Creative writing and Claude - amusing that you say that, given that Anthropic just went and tried to unfuck it in Opus 5.5 specifically. It is an example of a capability no one typically cares about, yes. No money in creative writing. But even there, we had gains in newer models.