News for hackers. Stuff that matters.
Re:Claude Sonnet 4.5 by simonw on Monday September 29, 2025 @07:31PM (#45420167)
I got an amazing result from ChatGPT a while back - an SVG with a perfect illustration of a pelican riding a bicycle.

It was suspiciously good in fact... so I downloaded the SVG file and found out it had generated a raster image with its image tool and then embedded it as base64 binary image data inside an SVG wrapper!

Re:Claude Sonnet 4.5 by dhhugley on Monday September 29, 2025 @08:10PM (#45420436)
You’ll just have to move the goalpost then; perhaps it can be a multidimensional pelican saving the multiverse, or an invisible pelican that only you can see and critique.
Re:Claude Sonnet 4.5 by lxgr on Tuesday September 30, 2025 @04:59AM (#45423421)
How would that help, given that ChatGPT has apparently already figured out how to consistently and systematically game the benchmark by working in pixel space and only using SVG as a wrapper for a raster image?

FWIW, I could totally see a not hugely more advanced model using its native image generation capabilities and then running a vector extraction tool on it, maybe iteratively. (And maybe I would not consider that cheating, anymore, since at some point that probably resembles what humans do?)