Measuring AI Ability to Complete Long Tasks: Opus 4.5 has 50% horizon of 4h49M

Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by visarga on Sunday December 21, 2025 @02:25AM (#46342946)

Of course there is - if you write good tests, they compress your validation work, and stand in for your experience. Write tests with AI, but validate their quality and coverage yourself.

I think the whole discussion about coding agent reliability is missing the elephant in the room - it is not vibe coding, but vibe testing. That is when you run the code a few times and say LGTM - the best recipe to shoot yourself in the foot no matter if code was hand written or made with AI. Just put the screw on the agent, let it handle a heavy test harness.

[ Parent | on HN ]

Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by mmasu on Sunday December 21, 2025 @02:42AM (#46343012)

this is a very good point, however the risk of writing bad or non extensive tests is still there if you don’t know what good looks like! The grind will still need to be there, but it will be a different way of gaining experience

[ Parent | on HN ]

Re:Measuring AI Ability to Complete Long Tasks: Opus 4.5 has... by DANmode on Sunday December 21, 2025 @02:29PM (#46347527)

Starting to get it!

New skills, not no skills.

There will still be a wide spectrum of people that actually understand the stack - and don’t - and no matter how much easier or harder the tools get, those people aren’t going anywhere.

[ Parent | on HN ]