This is very similar to Picbreeder [1], which allows you to evolve art in a very similar manner, with evolutionary algorithms. It runs on the same evolutionary algorithm behind MarI/O [2], called NEAT [3].

[1] http://www.picbreeder.org/

[2] https://www.youtube.com/watch?v=qv6UVOQ0F44

[3] https://en.wikipedia.org/wiki/Neuroevolution_of_augmenting_t...