News for hackers. Stuff that matters.
Re:AI World Clocks by kburman on Friday November 14, 2025 @02:17PM (#45930816)
These types of tests are fundamentally flawed. I was able to create perfect clock using gemini 2.5 pro - https://gemini.google.com/share/136f07a0fa78
Re:AI World Clocks by Drew_ on Friday November 14, 2025 @02:25PM (#45930952)
The website is regenerating the clocks every minute. When I opened it, Gemini 2.5 was the only working one. Now, they are all broken.

Also, your example is not showing the current time.

Re:AI World Clocks by system2 on Friday November 14, 2025 @02:42PM (#45931206)
It wouldn't be hard to tell to pick up browser time as the default start point. Just a piece of prompt.
Re:AI World Clocks by dwringer on Friday November 14, 2025 @02:29PM (#45931018)
Even Gemini Flash did really well for me[0] using two prompts - the initial query and one to fix the only error I could identify.

> Please generate an analog clock widget, synchronized to actual system time, with hands that update in real time and a second hand that ticks at least once per second. Make sure all the hour markings are visible and put some effort into making a modern, stylish clock face.

Followed by:

> Currently the hands are working perfectly but they're translated incorrectly making then uncentered. Can you ensure that each one is translated to the correct position on the clock face?

[0] https://aistudio.google.com/app/prompts?state=%7B%22ids%22:%...

Re:AI World Clocks by allenu on Friday November 14, 2025 @02:26PM (#45930963)
I don't think this is a serious test. It's just an art piece to contrast different LLMs taking on the same task, and against themselves since it updates every minute. One minute one of the results was really good for me and the next minute it was very, very bad.
Re:AI World Clocks by jmdeon on Friday November 14, 2025 @02:21PM (#45930887)
Aren't they attempting to also display current time though? Your share is a clock starting at midnight/noon. Kimi K2 seems to be the best on each refresh.
Re:AI World Clocks by sinak on Friday November 14, 2025 @02:17PM (#45930829)
How are they flawed?
Re:AI World Clocks by earthnail on Friday November 14, 2025 @02:19PM (#45930862)
The results are not reproducable, as evidenced by parent poster.
Re:AI World Clocks by micromacrofoot on Friday November 14, 2025 @02:27PM (#45930989)
isn't that kind of the point of non-determinism?
Re:AI World Clocks by earthnail on Friday November 14, 2025 @05:49PM (#45933094)
No. Good nondeterministic models reproducibly generate equally desirable output - not identical output, but interchangeable.
Re:AI World Clocks by micromacrofoot on Friday November 14, 2025 @06:33PM (#45933452)
oh I see, thank you for clarifying