News for hackers. Stuff that matters.

A comment on Many SWE-bench-Passing PRs would not be merged. Parent comment

Re:Many SWE-bench-Passing PRs would not be merged by Sophira on Thursday March 12, 2026 @11:10AM (#47351786)
You know, this makes me wonder... is anybody actually prompting LLMs with pseudocode rather than an English specification? Could doing so result in code that that's more true to the original pseudocode?
[ Parent | on HN ]
Re:Many SWE-bench-Passing PRs would not be merged by zarzavat on Friday March 13, 2026 @09:55AM (#47364507)
You can give the macro-structure using stubs then ask the LLM to fill in the blanks.

The problem is that it doesn't work too well for the meso-structure.

Models tend to be quite good at the micro-structure because they've seen a lot of it already, and the macro-structure can easily be promoted, but the levels in between are what distinguishes a good vs bad model (or human!).

[ Parent | on HN ]
Re:Many SWE-bench-Passing PRs would not be merged by dyarosla on Friday March 13, 2026 @03:16PM (#47368448)
I’m not sure if it went anywhere but I remember there was this attempt at one point called Sudolang:

https://medium.com/javascript-scene/sudolang-a-powerful-pseu...

[ Parent | on HN ]