alechewitt

Nice work on these benchmarks Simon. I’ve followed your blog closely since your great talk at the AI Engineers World Fair, and I want to say thank you for all the high quality content you share for free. It’s become my primary source for keeping up to date.

I’ve been working on a few benchmarks to test how well LLMs can recreate interfaces from screenshots. (https://github.com/alechewitt/llm-ui-challenge). From my basic tests, it seems GPT-5.2 is slightly better at these UI recreations. For example, in the MS Word replica, it implemented the undo/redo buttons as well as the bold/italic formatting that GPT-5.1 handled, and it generally seemed a bit closer to the original screenshot (https://alechewitt.github.io/llm-ui-challenge/outputs/micros...).

In the VS Code test, it also added the tabs that weren’t visible in the screenshot! (https://alechewitt.github.io/llm-ui-challenge/outputs/vs_cod...).

My team at Amazon is currently hiring for software engineers, scientists and machine learning engineers to help us control and optimize Amazon's growing fleet of wind and solar farms. We are a new team with a lot of scope ahead of us. You can see some more info below:

- https://www.amazon.jobs/en/jobs/2165937/software-development...

- https://www.amazon.jobs/en/jobs/2159478/renewable-research-s...

- https://www.amazon.jobs/en/jobs/2079935/sr-applied-scientist...

This is incorrect. France has 135 GW of all electric power generation installed.That is 2 orders of magnitude different. https://en.m.wikipedia.org/wiki/Electricity_sector_in_France