Gzip as a classifier is surprisingly good and you should use it as a benchmark for your neural network.