News for hackers. Stuff that matters.
Re:The last six months in LLMs, illustrated by pelicans on b... by planb on Sunday June 08, 2025 @07:23AM (#44216265)
And by a sample that has become increasingly known as a benchmark. Newer training data will contain more articles like this one, which naturally improves the capabilities of an LLM to estimate what’s considered a good „pelican on a bike“.
Re:The last six months in LLMs, illustrated by pelicans on b... by cyanydeez on Sunday June 08, 2025 @08:20AM (#44216534)
So what you really need to do is clone this blog post, find and replace pelican with any other noun, run all the tests, and publish that.

Call it wikipediaslop.org

Re:The last six months in LLMs, illustrated by pelicans on b... by YuccaGloriosa on Sunday June 08, 2025 @12:30PM (#44217942)
If the any other noun becomes fish... I think I disagree.
Re:The last six months in LLMs, illustrated by pelicans on b... by criddell on Sunday June 08, 2025 @08:26AM (#44216571)
And that’s why he says he’s going to have to find a new benchmark.
Re:The last six months in LLMs, illustrated by pelicans on b... by viraptor on Sunday June 08, 2025 @09:22AM (#44216846)
Would it though? There really aren't that many valid answers to that question online. When this is talked about, we get more broken samples than reasonable ones. I feel like any talk about this actually sabotages future training a bit.

I actually don't think I've seen a single correct svg drawing for that prompt.