News for hackers. Stuff that matters.
Re:AutoDev: Automated AI-driven development by Microsoft by jerpint on Saturday March 16, 2024 @08:40AM (#39725397)
I agree that these benchmarks don’t mean as much anymore because it’s highly likely they were already present in the training set, but also believe it’s likely these tools will be significantly better in a few research cycles
Re:AutoDev: Automated AI-driven development by Microsoft by torginus on Saturday March 16, 2024 @09:03AM (#39725529)
A significant number of bugs just end in 'stupid mistake I didn't notice' or 'weird behaviour with a fix described on SO/docs/forum post'. Current day LLMs are much better positioned to solve these issues than humans are.