biobootloader

a new social experience...

Hey Paul, I'm a Mentat author.

> I also notice that the instructions prompt that mentat uses seems to be inspired by the aider benchmark? Glad to see others adopting similar benchmarking approaches.

We were inspired by you to use Exercism as a benchmark, thank you! We will add attribution for that. We switched our original instruction prompts for that benchmark to be similar to Aiders to allow for fair comparison.

> After looking around a bit, there seems to be a bunch of aider code in your repo. Some attribution would be appreciated.

We have an unused implementation of your output response format (https://github.com/AbanteAI/mentat/blob/main/mentat/parsers/...), but I don't know what else you are seeing? We implemented that to compare with our response formats and didn't find much difference in performance.

we are working on creating "real world" benchmarks that require a lot of context, and will report when we have results!

Yes, it uses your local files and edits for you. Let us know what you think!

https://github.com/AbanteAI/mentat

Abante AI | Full-time | Senior Software Engineer | Remote or Hybrid SF Bay Area

Abante AI is a new startup building Mentat, an open source, GPT-4 powered coding assistant. Mentat runs on the command line, gathering project context and coordinating edits across multiple files: https://github.com/biobootloader/mentat

- work with a small, talented team on an ambitious project

- open source: share what you build

- apply research to make a real product

- competitive pay + early equity

Contact me: [email protected]

the idea is that mentats in dune combine human and computer skills to assist others

but yeah it is funny

agreed! but it'd be nice to not have to jump back to the editor to fix a minor crash and then go rerun

it will sometimes fix other bugs, but yeah the focus is on ones that caused the crash or are obvious

haha yes it did feel a bit wild just letting this run on my machine!

I wouldn't recommend running it on a script that's supposed to delete files

Run your scripts with Wolverine and when they crash, GPT-4 edits them and explains what went wrong. Even if you have many bugs it will repeatedly rerun until it's fixed.

Demo video on twitter: https://twitter.com/bio_bootloader/status/163688020830443110...