I can't recommend this comment enough! So many people give outdated advice with regards to deep learning like "it requires too much data and takes too much time" and "start with something theoretically grounded (tm) like an SVM".

The truth is that an imagenet pre trained network will often work astonishingly well. The only other mark against deep learning is computational complexity, which I expect to go away soon (yours truly ;) )