I'm not the only one that had that idea, they're advertising these things as features now.
I don't know what's next, but keep in mind that today's LLM's are the worst they'll ever be.
That's like saying in 2011: "today's Google search is the worst it will ever be."
Enshitification is coming my friend. We're just now starting to see the kinds of refusals that LLMs will ultimately end up with to protect IP owners and the status quo. We'll look back at this time and marvel that LLMs used to be able to reverse engineer software, or able to create derivative IP works.
I wonder if we are seeing them maxing out llm model capabilities now...
6.1 made a lot of assumptions and would "just do it." For many professionals that was a bad thing. For mnay users it was a good thing.
6.2 on the other hand does what it's told, and uses less flowery language.
I think they're focusing more on the enterprise.
But I wasn't talking about subjective experience I was talking about benchmarks like artificial analysis for coding agents, where it gets slightly lower score than 6.1 (frontier code 2.0 it gets a 2 point drop).
It was 100% different though, and it was a bit jarring. It was kind of like having one of your coworkers replaced with a similar, but different, pod-person. I'm getting used to that feeling though.
The one thing I think we can all agree is certain is that it will be different in a few months.
I kind of wish they had LTS versions of some models, so you could build processes and tooling around them with certainty that they'd be exactly the same in 5 years.
They are going to be 'better than what they are today' but I don't see obvious unlocks.
We need more abstractions on top of them.
LLMs are hugely suited to code because it's token heavy and the compiler is the RLHF verifier.
The LLMs are still very bad at concepts.
What we see in code does not translate to other, arbitrary domains.
Legal - yes, due to text heavy content with tons of great examples as well.
Everything else ... not really. At least not LLMs as we understand them today.