News for hackers. Stuff that matters.
Re:Vote on which of Hacker News' challenges for AI have been... by Retr0id on Thursday October 01, 2026 @02:46PM (#49925509)
Heh, there's one of mine: https://stoppels.ch/goalposts/?c=39727943

"GPT-4 looks at original ASCII art of a foot, not copied from the web, and says it is a foot."

The vote is currently 64% yes, 18% no.

Just now I asked Opus 5.5 to generate an ASCII art foot, and it did a passable job. It's not great, but it's a foot. Then I pasted it into ChatGPT (whatever they're serving to the free tier by default, which seems to be 5.6 Luna), and it said it was a "train/locomotive": https://chatgpt.com/share/6abeaa39-cc80-83ed-851f-29370db089...

Maybe it's Opus's fault for drawing a bad foot but I think it's fair to say LLMs are still pretty bad at ASCII art (without additional tool calling etc).

Re:Vote on which of Hacker News' challenges for AI have been... by tedsanders on Thursday October 01, 2026 @02:58PM (#49925675)
For me, 6.1 Sol nailed it immediately:

> A bare foot and ankle, pointing right, with three little toes.

I wonder how much of the wide variation in perceptions of LLM capabilities is driven by the gulf between free models and frontier models. Luna getting something wrong is not always great evidence for LLMs be unable to do that thing.

Edit: for the curious skeptics without access to 6.1 Sol, I tried 3 times and it got it right all 3 times. Convo share link: https://chatgpt.com/share/e/6abeb955-7614-832e-a5e1-b1bd134f...

Re:Vote on which of Hacker News' challenges for AI have been... by ben_w on Thursday October 01, 2026 @03:02PM (#49925735)
Case in point, this nonsense came out of 5.6 Luna: https://chatgpt.com/share/6abeae1e-42b4-83ed-8966-7e82ae0bef...

Like, is this an ice-cream? A tooth?

Re:Vote on which of Hacker News' challenges for AI have been... by tomalbrc on Thursday October 01, 2026 @03:21PM (#49925944)
Please share a link to the conversation, otherwise I am not buying it.

Because "for me DeepSeek Flash 4.1 nailed it immediately", trust me bro.

Re:Vote on which of Hacker News' challenges for AI have been... by Kotlopou on Thursday October 01, 2026 @07:59PM (#49928405)
The share link doesn't work for me, it says I don't have access. I can see the one from the parent, so the problem is likely on your side.
Re:Vote on which of Hacker News' challenges for AI have been... by ben_w on Thursday October 01, 2026 @02:58PM (#49925684)
Mm, I kina agree with the AI on this one:

   (_)(_)(_) represents the wheels
They do look rather wheel-like; I have to assume you see them as toes though?

It's like the duck-bunny picture to me. If I focus on the "wheels", I see a steam train locomotive (but perhaps I'm only seeing that because I read your comment?); if I look at the ankle I see a foot.

Re:Vote on which of Hacker News' challenges for AI have been... by howunfortunate on Thursday October 01, 2026 @03:08PM (#49925792)
Readers: before you vote or comment, look at that foot.

I think I would have failed this test!

Re:Vote on which of Hacker News' challenges for AI have been... by hydrolox on Thursday October 01, 2026 @03:13PM (#49925851)
To be fair if a human was given a linear sequence representing ascii art you couldn't tell either
Re:Vote on which of Hacker News' challenges for AI have been... by nonameiguess on Thursday October 01, 2026 @03:14PM (#49925862)
This is a Rorschach test, not a foot. If you'd shown this to me without telling me what it was meant to be first, I'd have guessed a crematorium.
Re:Vote on which of Hacker News' challenges for AI have been... by dec0dedab0de on Thursday October 01, 2026 @03:16PM (#49925889)
Has anyone done Roschach tests for AI? That would be an interesting study to see how different models responded.
Re:Vote on which of Hacker News' challenges for AI have been... by shagie on Thursday October 01, 2026 @09:08PM (#49928842)
Using https://rorschachgenerator.org

https://chatgpt.com/share/6abf02ae-9a40-83e9-a432-00bf064f60...

The images: https://imgur.com/a/ig6sn6I

... They're not what I would have described. For me, 99.something% flesh and blood with less than 1% metal, glass, and probably some microplastics...

The first one I see a person with a big tall hat and a big nose.

The second one... I do see the black statue with a figure in white in front of it.

The third one is immediately two fish looking at each other.

Re:Vote on which of Hacker News' challenges for AI have been... by lbreakjai on Friday October 02, 2026 @04:31AM (#49931191)
Where did you find those three pictures of my parents getting divorced??
Re:Vote on which of Hacker News' challenges for AI have been... by adam_rb on Thursday October 01, 2026 @05:53PM (#49927505)
I think the problem is that you're using basing your conclusion from the cheap/dumb models available on the free tier of services. I just asked GPT6-Astra in Codex and it replied:

"It’s ASCII art of a bare foot and lower leg, with the toes pointing to the right."

No tool calling, just an immediate reply with the correct answer.

Re:Vote on which of Hacker News' challenges for AI have been... by brudgers on Thursday October 01, 2026 @06:16PM (#49927701)
Sure, but it’s already read the HN thread.
Re:Vote on which of Hacker News' challenges for AI have been... by akavi on Thursday October 01, 2026 @07:16PM (#49928155)
...that's not how LLM training works.
Re:Vote on which of Hacker News' challenges for AI have been... by asdfasgasdgasdg on Thursday October 01, 2026 @07:00PM (#49928060)
Opus 5.5 was able to parse and understand an ASCII art foot when I pasted one in.
Re:Vote on which of Hacker News' challenges for AI have been... by hyperpape on Thursday October 01, 2026 @07:48PM (#49928339)
I'm a human, and that's not a foot, it's a smokestack.

But as you pointed out, while that absolves ChatGPT, it makes Opus look worse.

Re:Vote on which of Hacker News' challenges for AI have been... by janalsncm on Thursday October 01, 2026 @08:29PM (#49928576)
A better test would be using an image to ascii converter tool to rule out bad ascii drawing from Opus.
Re:Vote on which of Hacker News' challenges for AI have been... by qnleigh on Saturday October 03, 2026 @02:43PM (#49946652)
I wouldn't have guessed foot either, and I'm a human.*

*In case there's any doubt, there are three r's in strawberry.