News for hackers. Stuff that matters.
Re:Our Smallest, Most Efficient Model: Muse Ember by AlecSchueler on Monday November 09, 2026 @02:38PM (#50430682)
Any idea why there's so much convergence on the fish in a basket idea?
Re:Our Smallest, Most Efficient Model: Muse Ember by swatcoder on Monday November 09, 2026 @02:49PM (#50430884)
[delayed]
Re:Our Smallest, Most Efficient Model: Muse Ember by mvkel on Monday November 09, 2026 @03:10PM (#50431223)
This is interesting. There's a balance between:

- simple prompt for complex output (bad)

- complex prompt for simple output (bad)

- simple prompt for simple output (good)

- complex prompt for complex output (.... is this good or bad?)

Re:Our Smallest, Most Efficient Model: Muse Ember by viraptor on Monday November 09, 2026 @04:01PM (#50432067)
To be fair, people have a genuine preference for images with things facing to the right. And lots of drawings will do 3 motion lines. You'd likely draw a dashed rather than solid separator too, or it would look like a random line. Lots of the AI habits are there because of choices we make.
Re:Our Smallest, Most Efficient Model: Muse Ember by AlecSchueler on Tuesday November 10, 2026 @04:01AM (#50437765)
Exactly, but that doesn't explain the fish.
Re:Our Smallest, Most Efficient Model: Muse Ember by Novosell on Tuesday November 10, 2026 @06:01AM (#50438584)
Leave these poor pelicans and their choice of lunch alone, sheesh.
Re:Our Smallest, Most Efficient Model: Muse Ember by viraptor on Tuesday November 10, 2026 @07:10AM (#50439187)
Doesn't it, or do we not know the answer? I'd ask people to start adding elements to the picture and see how quickly the fish appears.

There aren't that many associations left once we're primed with a bike and a pelican. It's like that old mental trick "What's the colour of the clouds? What's the colour of the snow? What do cows drink?"

Re:Our Smallest, Most Efficient Model: Muse Ember by AlecSchueler on Tuesday November 10, 2026 @04:00AM (#50437756)
> The shorter and vaguer a prompt you give to an LLM, the more it fills in further details using associations they've developed through training.

I can see that for stuff like facing right because characters in images generally do face right, and roads generally do have dashed white line separators. But putting a fish in a basket seems like a stretch of creativity—one that I would rather it not make unless prompted to—so it's surprising that every single model now seems to insist on it.

Re:Our Smallest, Most Efficient Model: Muse Ember by dstu on Tuesday November 10, 2026 @05:06AM (#50438179)
The models do all seem to converge in ways that, on occasion, wouldn’t seem obvious. But I suppose since they’re all products of the same core training data it’s inevitable that when they’re given the opportunity to fill in the blanks they come to the same conclusions. This seems to be true regardless of what modality you’re working with.

If there isn’t a concerted effort against it the world is going to start to look and feel ever more homogenous.

Re:Our Smallest, Most Efficient Model: Muse Ember by Buttons840 on Monday November 09, 2026 @05:16PM (#50433054)
There's only one average in a set.