Re:The last six months in LLMs, illustrated by pelicans on b...
by planb on Sunday June 08, 2025 @07:23AM
(#44216265)
And by a sample that has become increasingly known as a benchmark. Newer training data will contain more articles like this one, which naturally improves the capabilities of an LLM to estimate what’s considered a good „pelican on a bike“.
[ Parent
| on HN ]
Re:The last six months in LLMs, illustrated by pelicans on b...
by cyanydeez on Sunday June 08, 2025 @08:20AM
(#44216534)
So what you really need to do is clone this blog post, find and replace pelican with any other noun, run all the tests, and publish that.
Call it wikipediaslop.org
Re:The last six months in LLMs, illustrated by pelicans on b...
by YuccaGloriosa on Sunday June 08, 2025 @12:30PM
(#44217942)
If the any other noun becomes fish... I think I disagree.
Re:The last six months in LLMs, illustrated by pelicans on b...
by criddell on Sunday June 08, 2025 @08:26AM
(#44216571)
And that’s why he says he’s going to have to find a new benchmark.
Re:The last six months in LLMs, illustrated by pelicans on b...
by viraptor on Sunday June 08, 2025 @09:22AM
(#44216846)
Would it though? There really aren't that many valid answers to that question online. When this is talked about, we get more broken samples than reasonable ones. I feel like any talk about this actually sabotages future training a bit.
I actually don't think I've seen a single correct svg drawing for that prompt.