News for hackers. Stuff that matters.
Re:Ask HN: Share your AI prompt that stumps every model by svcrunch on Thursday April 24, 2025 @07:11PM (#43788540)
Here's a problem that no frontier model does well on (f1 < 0.2), but which I think is relatively easy for most humans:

https://dorrit.pairsys.ai/

> This benchmark evaluates the ability of multimodal language models to interpret handwritten editorial corrections in printed text. Using annotated scans from Charles Dickens' "Little Dorrit," we challenge models to accurately capture human editing intentions.

There are no comments on this comment yet.