News for hackers. Stuff that matters.
Re:Is there a tension between creativity and accuracy? by MrQuincle on Monday May 29, 2017 @07:52AM (#14438642)
Neural networks also need to balance exploration and exploitation. You will find it in the form of:

+ generalization / overfitting

+ cross-domain knowledge transfer

In a more embodied approach it is free energy minimization as advocated by Friston. Consider us divided by the world through a Markov blanket, or even better consider our actions and perceptions divided by one. How do we continuously surprise ourselves without getting mad?

A guy who would say it's the same thing is probably Polani with empowerment: https://arxiv.org/abs/1310.1863. The rational choice is to navigate to that location in state space where you have most decisions.

I think curiosity-based research is quite interesting from the perspective of rationality and creativity.

There are no comments on this comment yet.