This is an excellent syllabus by Professor Dave Touretzky, a pioneer in deep learning. He started the Connectionists mailing list and was heavily involved in the early days of NIPS.

Sign up here: https://mailman.srv.cs.cmu.edu/mailman/listinfo/connectionis...

For anyone who thinks there was ever a pause in deep learning progress, the Connectionists archives beg otherwise!