the smallest compressor is just the (differentiable) classier itself. The compressed image is just the output class, and the de-compressor generates a random image then back propagates the class error until it gets an image that has the right class. Maybe you toss in a random seed in the format, so the compressor can spend some more time to guarantee the de-compressor will complete in a reasonable amount of time.