News for hackers. Stuff that matters.
Re:IBM's new SWE agents for developers by colonwqbang on Tuesday October 22, 2024 @05:40PM (#41919022)
Classic machine learning researcher trick: just select your test example from the training set! It certainly saves a lot of effort.
Re:IBM's new SWE agents for developers by wmal on Tuesday October 22, 2024 @05:47PM (#41919071)
That’s true, but this repo has thousands of bugs. They could at least find one that was in the training set, but also did not contain the location in the bug description.

This way it would at least look like it may work

Re:IBM's new SWE agents for developers by toomuchtodo on Tuesday October 22, 2024 @05:51PM (#41919096)
Decision makers and those writing the check aren’t sophisticated enough to know the difference, in my experience with orgs that buy from IBM.
Re:IBM's new SWE agents for developers by negoutputeng on Tuesday October 22, 2024 @06:17PM (#41919297)
every hype cycle runs through a predictable course.

we are at a phase where the early adopters have seen the writing on the wall.. ie that llms are useful for a limited set of usecases. but there are lots of late adopters who are still awestruck and not disillusioned yet.

Re:IBM's new SWE agents for developers by colonwqbang on Tuesday October 22, 2024 @06:01PM (#41919182)
Indeed. It's also amusing how it produces a multi-page essay on the bug instead of submitting a pull request with an actionable fix.