News for hackers. Stuff that matters.
Re:Gemini 4 Argon by nomel on Tuesday October 13, 2026 @02:13PM (#50076115)
Yet, they're all almost exactly the same in style and composition.
Re:Gemini 4 Argon by orbital-decay on Tuesday October 13, 2026 @02:40PM (#50076549)
Certainly not because all labs are pelicanmaxxing on the same exact image. Most patterns are similar everywhere. That's the result of training on the same datasets and scraped web contaminated with other models' outputs, combined with similar training methods and resulting mode collapse. Try if e.g. dolphins knitting socks in spacesuits are similar on all/most models.
Re:Gemini 4 Argon by nomel on Tuesday October 13, 2026 @07:23PM (#50080364)
This and your original comment aren't compatible.
Re:Gemini 4 Argon by orbital-decay on Tuesday October 13, 2026 @08:26PM (#50080861)
How so?
Re:Gemini 4 Argon by nomel on Wednesday October 14, 2026 @03:47AM (#50083910)
> It's either a capability to generate arbitrary SVGs (or even something broader), or no specific training at all.

> That's the result of training on the same datasets and scraped web contaminated with other models' outputs

Maybe I'm misinterpreting though, or just semantics. I would consider contamination, or whatever the first example was that they all matched, as specific training data, along with all the duplications of. I doubt it's model collapse to the same pelican, without the same original example.

Re:Gemini 4 Argon by orbital-decay on Wednesday October 14, 2026 @08:45AM (#50086865)
Perhaps you're right, this would probably take some rigorous forensics to resolve definitely. Somehow all models have very similar patterns in text, seemingly at random. I don't think everyone is trying to train on specific patterns on purpose, it's a pretty general phenomenon. (I'm talking about mode collapse, not model)