News for hackers. Stuff that matters.
Re:Learning Concepts with Energy Functions by jerf on Wednesday November 07, 2018 @01:45PM (#18401166)
Solomonoff induction is not representative of human intelligence.

At least, speaking for myself, I do not exhaustively search literally every hypothesis and match it against my data. Your mileage may vary. Dunno. It's a diverse world out there, right?

Re:Learning Concepts with Energy Functions by Xcelerate on Wednesday November 07, 2018 @02:49PM (#18401781)
> I do not exhaustively search literally every hypothesis and match it against my data

Haha. My problem is that my brain attempts to do this but can’t, which just leads to analysis paralysis instead.

Re:Learning Concepts with Energy Functions by heavenlyblue on Wednesday November 07, 2018 @04:06PM (#18402406)
>> I do not exhaustively search literally every hypothesis and match it against my data

Are you implying you're a prodigy who's never fallen while learning to walk as a kid?

Re:Learning Concepts with Energy Functions by yters on Wednesday November 07, 2018 @01:48PM (#18401194)
Solomonoff induction is a way to quantify the human ability to induce general principles from limited observations. All the computable methods are unable to achieve this ability.
Re:Learning Concepts with Energy Functions by jerf on Wednesday November 07, 2018 @04:35PM (#18402610)
With respect, no, that is not what it is. My summary is glib and phrased in non-mathematical terms, but closer.

A true Solomonoff Inductor would be wildly, wildly smarter than a human being, if it could get over the problem that such a machine would also consume super-exponentially more resources than the universe has.

Re:Learning Concepts with Energy Functions by yters on Wednesday November 07, 2018 @04:50PM (#18402707)
It's not a matter of resources. Solomonoff induction is not computable, since it needs to calculate the Kolmogorov complexity of the data.

If that is what is required for induction, it is surprising that humans are able to do so well at identifying concise descriptions of the data we observe. This seems inexplicable with a computational view of human cognition.

Re:Learning Concepts with Energy Functions by yters on Thursday November 08, 2018 @07:35AM (#18405812)
Disregard, I realized my error is that the elegant program is guaranteed to halt at some point, which gives us the Kolmogorov complexity. We just will never know when that happens, even with infinite resources.