as mentioned elsewhere this is from nearly six years ago and uses a very crude model for curiosity - and poses this as some sort of unsolveable problem instead of a decision made by the researchers in order to investigate particular behaviors of the systems they were working with.

It is a fun thought experiment - how do our brains systems manage to reward seeking new information without getting trapped by simplistic pseudo-RNG patterns in nature