News for hackers. Stuff that matters.
Re:GPT-5.6 by aappleby on Thursday July 09, 2026 @03:29PM (#48851217)
Surely "how to draw a SVG pelican on a bike" has made it into the training data by now ...
Re:GPT-5.6 by astrange on Thursday July 09, 2026 @03:41PM (#48851379)
If that was the case in a non-trivial way you'd see mode collapse, but you don't, they come out differently.
Re:GPT-5.6 by tlamponi on Thursday July 09, 2026 @03:47PM (#48851450)
It's because all the frequent comment that this pelican is in the trainings set now also got into the trainings set and models adapt. /joking (I hope)
Re:GPT-5.6 by huseyinkeles on Thursday July 09, 2026 @03:33PM (#48851278)
Surely this comment is literally on every new model release post.
Re:GPT-5.6 by simonw on Thursday July 09, 2026 @03:52PM (#48851519)
It's part of the pelican tradition at this point.
Re:GPT-5.6 by dannyobrien on Thursday July 09, 2026 @04:42PM (#48852094)
I eagerly await the models replying with that: "I'd be happy to create a pelican riding a bicycle, but just a note that this might already be in my training data. Simon."
Re:GPT-5.6 by simonw on Thursday July 09, 2026 @05:11PM (#48852428)
Someone told me that a model said "oh, the classic" when they asked for this recently. I think that was Opus 4.8.
Re:GPT-5.6 by conception on Thursday July 09, 2026 @03:33PM (#48851274)
And yet... only one is any good.