> Does it teach us anything fundamentally new? No, it still has horrible sample complexity and does not generalize to anything outside of Atari unless you completely re tune it.

I thought it was interesting that they let the agent learn the exploration/exploitation tradeoff, also combining memory and intrinsic motivation.

Another contribution of this paper would be that they showed all these tricks can build on each other, thus, are complementary.

Humans brains are also a bag of tricks fine-tuned to the goal and requirements of making more humans.