News for hackers. Stuff that matters.
Re:Chomsky and the Two Cultures of Statistical Learning by lostmsu on Friday November 06, 2026 @05:34PM (#50399403)
[delayed]
Re:Chomsky and the Two Cultures of Statistical Learning by suddenlybananas on Saturday November 07, 2026 @03:20AM (#50402699)
Not a specific entry, but in four years, there's never been a clear advantage of multimodal models and the results have been extremely lackluckster, even when you allow unbounded images alongside a fixed quantity of text.
Re:Chomsky and the Two Cultures of Statistical Learning by lostmsu on Saturday November 07, 2026 @05:52AM (#50403407)
[delayed]
Re:Chomsky and the Two Cultures of Statistical Learning by suddenlybananas on Saturday November 07, 2026 @10:08AM (#50405190)
You can look at the CFP for the most recent BabyLM https://arxiv.org/html/2602.20092v2 :

"This year, we have merged the Multimodal and Interaction tracks into the Strict and Strict-small tracks. This is for two primary reasons: Firstly, there were insufficient submissions to warrant standalone tracks. Secondly, none of the submissions in the Interaction track outperformed models submitted to the Strict track, and *none of the submissions from Multimodal outperformed our baselines*. We will still allow participants to use multimodal data or interactive training procedures if they choose, but such data or learning procedures must conform to the rules of the Strict or Strict-small tracks.

Emphasis mine.

Re:Chomsky and the Two Cultures of Statistical Learning by lostmsu on Saturday November 07, 2026 @02:05PM (#50407070)
[delayed]
Re:Chomsky and the Two Cultures of Statistical Learning by lostmsu on Saturday November 07, 2026 @02:15PM (#50407155)
[delayed]
Re:Chomsky and the Two Cultures of Statistical Learning by suddenlybananas on Sunday November 08, 2026 @06:55AM (#50412488)
https://aclanthology.org/2025.babylm-main.28/

The multimodal baselines are _lower_ than the text only baselines. See Table 3. In fact, 10M of text outperforms 100M of text + images.