http://people.idsia.ch/~juergen/interest.html
IIRC, DeepMind is also working on such goal functions to get their Atari playing RL-based AI to seek more data about the world even when it does not immediately help achieving the main goal function (achieving a high score).
Novelty seeking behavior probably has evolved because there are just not enough immediate rewards in our world to teach us everything that is nesessarey to reproduce [0]. Thus the brain rewards itself for exploring new things which has a collateral effect that we are interested in art and can find intrinsic motivation in all kinds of things (science, work, hobbies etc.).
[0] which does not mean that we are here to maximize the number of our babies. We aren't fitness maximizers ourselves, but we are just adaptation executors of genetic code that has necessarily been shaped by such goals (since the alternative to reproduction is to not reproduce, i.e. going extinct). In other words: We are free do whatever we want!
I think this is very well put, bravo.
There are theories that intelligence comes about from relatively simple processes that generate complex structures. If we can model these simple processes and throw increasing amounts of computing power at it, perhaps we can actually get to something we agree is intelligent. This is largely done through cost functions: directing the structure to a sensible direction when we can. Now, I think this approach may very well be a dead end on the road to general AI. At the least, I think we're nowhere near it in our current direction. But it's taking us in interesting directions.
Now, what is emotion? My impression is emotion is potentially far more complex, abstract, and ill-defined than intelligence. At the least, we see it from a super biased perspective because our brain is good at lying to us. Much like we never really see our own nose even though we're ALWAYS looking right at it, maybe our brain is really good at hiding emotions. Like an old friend of mine who was probably clinically depressed but didn't realize it for months. This is why I think modeling emotions would be really difficult.
My guess is whenever we figure out intelligence (50 years from now?) it will be much easier to figure out how emotion can come out of that intelligence. Maybe it will even be emergent - for example, the AI is smart enough to realize something is wrong, so it feels fear. It realizes things are going well for it, so it is happy. Etc.
http://eplex.cs.ucf.edu/noveltysearch/userspage/ http://www.amazon.com/Why-Greatness-Cannot-Planned-Objective...
I'm a big fan, and would love to talk about this anytime.
It looks very interesting. What do you feel are the main take-aways with regard to reinforcement learning?
The bots would have a number of emotions, and certain events would affect different emotion-levels. Like, a hit/miss from a bot against another would increase/decrease the "confidence" meter, and getting hit by an enemy would increase the "fear" meter.
The total state of all meters would drive the high-level behavior, like fight/flee and weapon choice.
Because, among many other reasons, an AI going through the "terrible two(minute)s" could decide to destroy the world, or simply do so by accident. We will have a hard enough time building AI that doesn't do that when we set that specifically as our goal, let alone trying to "raise" an AI like a child.
> Edit: Oh, and for the love of god, please airgap the thing at all times...
Not even close to sufficient. See https://en.wikipedia.org/wiki/AI_box for how humans would voluntarily let it out, and papers like https://www.usenix.org/conference/usenixsecurity15/technical... for how it would let itself out.
[1] https://aeon.co/essays/how-close-are-we-to-creating-artifici...
I'd argue that if possible, it has great potential for both: AI provides one of the most universal solutions to a wide range of problems humanity faces, while simultaneously providing an existential threat of its own if it goes badly.
Let's stay with video games for a bit. What if we look at joy as 'seeing the world change', graded by the degree of indirection from our inputs (the longer it cascades, the more joy it gets). Maybe let it have preference for certain color tones and sounds, because that's also how games give us hints about whether what we do is good or not. Boredom is what sets us on a timer - too many repetitions of the same thing and the AI gets bored. Fear and disgust is something that comes out of evolutionary processes, so it might be best to add a GA in there that couples success with some fear like emotion. Anger, well, maybe wait with that ;-).
Edit: Oh, and for the love of god, please airgap the thing at all times...