News for hackers. Stuff that matters.
Re:ARC-AGI without pretraining by ta8645 on Tuesday March 04, 2025 @05:06PM (#43260300)
It takes knowledge to even know they're flawed, noisy, and disconnected. There's no reason to "correct" anything, unless you have knowledge that applying previously "understood" data has in fact produced deficient results in some application.

That's reinforcement learning -- an algorithm, which requires accurate knowledge acquisition, to be effective.

Re:ARC-AGI without pretraining by esafak on Tuesday March 04, 2025 @05:58PM (#43260658)
Every statistical machine learning algorithm, including RL, deals with noisy data. The process of fitting aims to remove the sampling noise, revealing the population distribution, thereby compressing it into a model.

The argument being advanced is that intelligence is the proposal of more parsimonious models, aka compression.

Re:ARC-AGI without pretraining by ta8645 on Tuesday March 04, 2025 @06:16PM (#43260783)
I've lost track of what we're disagreeing about.