You still need TITAN for any reasonable custom datasets (with non-trivial data). The current CPU implementation doesn't support Dropout, therefore, you can only play it with CIFAR-10 (./bin/cifar-10.c) dataset if you don't have a GPU.
This is an preliminary implementation, I do plan to finish up CPU training part to be on-par with GPU in subsequent releases.
Unless this more an issue with the model size of the "Krizhevsky net" being on the order of 6GB?
Also, does this mean you managed to get a 2D convolutional kernel optimized for Kepler architectures? If so, that is awesome! Alex's code is still only optimized for Fermi architectures if I recall correctly.
The code is never optimized to the extreme. I optimized the code to the point of being able to finish at reasonable time (9 days for 100 epochs). The convolutional kernel is parametrized (with template and some macro tricks, forward and backward propagation convolutional kernels are parametrized into hundreds of small functions) and the best parameters were chose with a mini benchmark in the beginning of training process.
Are the floating point outputs of a program then "tainted" by the license of the code as well? If not, why not use the state of the art, which handles both localization AND classification?
I can see using ccv for custom datasets, though I am also assuming the 6GB TITAN requirement for GPU use is only for ImageNet, and not for a custom dataset? TITAN GPUs are pretty expensive...
I am very impressed by the result, as I have not been able to even approach OverFeat with my own work (pylearn2 + theano) thus far. Will definitely be experimenting with this in the future. Thanks!