News for hackers. Stuff that matters.
Re:Karl Friston: a neuroscientist who might hold the key to ... by jamii on Tuesday November 20, 2018 @06:50AM (#18493158)
Notes from the last time I tried to understand this - https://www.lesswrong.com/posts/wpZJvgQ4HvJE2bysy/god-help-u...
Re:Karl Friston: a neuroscientist who might hold the key to ... by conjectures on Tuesday November 20, 2018 @11:07AM (#18494854)
Thanks - I found this very useful.

> From the Alius interview:

"The free energy principle stands in stark distinction to things like predictive coding and the Bayesian brain hypothesis. This is because the free energy principle is what it is — a principle. Like Hamilton’s Principle of Stationary Action, it cannot be falsified. It cannot be disproven. In fact, there’s not much you can do with it, unless you ask whether measurable systems conform to the principle."

This is a big kahuna burger of a bullet to bite!

Re:Karl Friston: a neuroscientist who might hold the key to ... by prossercj on Tuesday November 20, 2018 @11:17AM (#18494959)
That was great, thanks.

This all reminds me of Socrates' claim in the Theatetus that "Philosophy begins in wonder," wonder being roughly equivalent to the the desire to reduce uncertainty, and the Platonic idea that philosophy is central to the good life.

Which leads to the ubiquitous Whitehead quote about western philosophy consisting of footnotes to Plato...

Re:Karl Friston: a neuroscientist who might hold the key to ... by sydd on Tuesday November 20, 2018 @08:52AM (#18493752)
Thanks, it was a great read!

From what I get this whole thing is more like an abstract ruleset describing how decision making in the brain works, rather than a brain model. Or am I wrong, is there anyone who built a network model based on this theory?

Re:Karl Friston: a neuroscientist who might hold the key to ... by atschantz on Tuesday November 20, 2018 @12:35PM (#18495669)
In terms of the free energy 'principle', it makes no predictions about how free energy minimized. But there have been multiple process theories suggested, most notably predictive coding (which is a dominant paradigm in neuroscience) [1] and variational message passing [2].

[1] https://en.wikipedia.org/wiki/Predictive_coding [2] http://www.jmlr.org/papers/volume6/winn05a/winn05a.pdf

Re:Karl Friston: a neuroscientist who might hold the key to ... by eli_gottlieb on Tuesday November 20, 2018 @01:36PM (#18496365)
Isn't variational message-passing the algorithmic-level theory about where predictive coding comes from?
Re:Karl Friston: a neuroscientist who might hold the key to ... by atschantz on Tuesday November 20, 2018 @01:54PM (#18496568)
I think you might be right, a quote from Friston on the relationship (in reference to belief propagation):

"We turn to the equivalent message passing for continuous variables, which transpires to be predictive coding [...]"

It could be that belief propagation is in the context of discrete variables, whereas predictive coding is in the context of continuous, both of which are a form of (variational) message passing.

Re:Karl Friston: a neuroscientist who might hold the key to ... by eli_gottlieb on Tuesday November 20, 2018 @01:27PM (#18496264)
I endorse the responses labeled with my name.