Also, take a look at some of the work by J.Schmidhuber (http://www.idsia.ch/~juergen/). For example, the LSTM architecture is quite powerful. And he very successfully applied those RNN models to a wide number of areas (handwriting recognition, robotics, ...).