Re:Qwen4-Max
by Starlevel004 on Sunday November 15, 2026 @11:08PM
(#50513906)
Feels like Pelicanbench is getting saturated now. Maybe time to switch to a different animal and vehicle combo?
[ Parent
| on HN ]
Re:Qwen4-Max
by slashtrends on Sunday November 15, 2026 @11:14PM
(#50513945)
The 3d one still produces interesting variations - https://www.reddit.com/r/ClaudeCode/comments/1xs4ll7/fable_5...
First thing I do when a new model drop is scroll down to find the pelican comment, and then the "the pelican benchmark is no longer useful" debate under it.
Re:Qwen4-Max
by wasabi991011 on Monday November 16, 2026 @12:42AM
(#50514431)
You say that, but it still takes quite a bit of reasoning to get the pelican's legs on different sides of the bike and to get the bike chain included.
I feel like randomly even at max reasoning they get the legs wrong. Or the pedal. Or both.
I don't know if I've ever seen a bent leg. Legs always go straight to pedals with no knees. The models might have an idea of what it looks like but seem to have no understanding of how it works.
The last set of Gemini models definitely had knees and bent legs. But the knee looked like a ball.
Bird knees are also quite weird though. Don't some bend backwards ?
Re:Qwen4-Max
by forrestthewoods on Monday November 16, 2026 @12:55AM
(#50514496)
Kind of yes. Except from an artistic perspective they're all still awful.
What if it's been a Stork this whole time?
[delayed]