So how much computational effort would it take to train with a different set of images, to reach the same level of training as this existing data?
Would it be possible on a simple commercial computer?
OpenCL support is coming, but it's not as performing as CUDA support yet for Caffe.
Grab a couple of video cards and have fun!
In particular, if you train ConvNets on other data you will get very different hallucinations. It might be interesting to train (or even fine-tune) the networks on different data and see how the results vary. For example, different medical datasets, or datasets made entirely of faces (e.g. Faces in the Wild data), galaxies, etc.
It's also possible to take Image Captioning models and use the same idea to hallucinate images that are very likely for some specific sentence. There are a lot of fun ideas to play with.