eivindmeyer

we built zeroshot.sh to let you mechanically enforce this flow (and any other topology), want to check it out? :)

why measure something you can just enforce with something like opcore which we have built? https://github.com/the-open-engine/opcore/

You can standardize your entire review flow across your team and have it match your QA requirements with zeroshot.sh - could be worth checking out. I am one of the maintainers.

We are building zeroshot.sh to automate the entire implementation, review, and acceptance testing workflow as a customizable graph with adverserial cycles that you can define to match your QA requirements. Should be relevant to check out for people in this thread. MIT open-source.

We built it for ourselves and havent reviewed code since starting to use it.

We had some nice results showing that this actually helps (it has been our intution for a long time, but nice to show it!)

https://theopenengine.com/blog/review-loop/

We built zeroshot.sh to automate our entire review and testing workflow. We found that the only thing that really worked was adverserial review cycles and that they had to be mechanically enforced, not based on instructions in skills. Should be relevant for you to check out :)

You can automate this entire orchestration with zeroshot.sh, mentioning it since it is relevant here.

We are also building a framework for mechanically enforced adverserial review cycles - think it could be relevant here so I am mentioning it: zeroshot.sh

Agents are fully capable of doing reviews as reliably as senior developers. They just need to be independent and adverserial, and validates the things you actually care about in your QA.

We havent done manual code review for months actually. It is not a problem if you have adverserial review loops that automate your QA and mechanically enforce the orchestration of them. That is basically what the zeroshot framework we are building is for.

Classic test theatre behavior. You can catch this with an adverserial reviewer though. This type of antipattern is why we build zeroshot

Classic assert true theatre lol

You dont have to review the code, but someone does. If it is a well-tuned adverserial reviewers, that would be more than sufficient. We are building zeroshot to let you customize that as a fixed graph for your repo, feel free to check it out!