My pet theory was that natural neural networks have built in learning mechanism that is prone to over-fitting. The way nature is overcoming the problem is periodically disconnecting inputs and outputs from the neural network and letting it trigger randomly for some time to add a bit of noise.

But it seems that more and more evidence shows up that sleep is just clean-up time for the brain.