cool project. i built something similar but for the terminal side — virtui (https://github.com/honeybadge-labs/virtui).

it lets agents drive terminal apps via pty, take screenshots, send keystrokes, and record everything as asciicast.

basically the same idea as proofshot but for tui/cli apps instead of browser ui. been using it to have agents prove their work actually when submitting prs.