1) Image recognition is done in so many different ways, but if you're using neural networks, why not take advantage of the geometry of the layout while simultaneously removing the need for learning about things like hidden node layers. Use HyperNEAT: http://eplex.cs.ucf.edu/hyperNEATpage/HyperNEAT.html
2) Financial data mining is potentially very dangerous. It's easy for people to create models that look very strong in back-testing but are actually just fitting to the relatively limited history of samples. Some people may be foolish enough to think they should take that signal and trade it with their own money-- yikes!
A much better introduction to ANNs would be in a reinforcement learning context, where you aren't worried about over-fitting as much. Mat Buckland's book does a pretty good job of covering these topics: http://www.amazon.com/Techniques-Programming-Premier-Press-D...
Yes, there are some general principles and concepts you need to know/understand, but nothing particularly deep.
Edit: Actually I'd highly recommend encog: it's very easy to use, it's extremely well documented and for those of us that do not have a formal education in NNs it's a great place to get started. http://www.heatonresearch.com/encog
I don't see why anyone non-mathematical would want using neuronal networks in the first place. There's lots of machine learning tools that are designed to work out of the box (decision trees, SVMs) whereas neuronal networks on the other hand give you greater flexibility but make it radically easier to shoot yourself in the foot if don't understand the whole thing. And "the whole thing" involves a gobload of math - including multidimensional calculus, little bits of probability theory, and numerical optimization.
That said, it's probably ok if you just want to get your feet wet to see what it's all about. There's even (decent) libraries for Python: http://deeplearning.net/software/theano/ http://code.google.com/p/pynnet/
Matching tutorial: http://deeplearning.net/tutorial/