Luckily, deep learning is built on super complicated mathematical foundations, but the practice isn't. You could quickly get up to speed with a library like Keras and be productive, building things and trying them out without needing years of theoretical training. I'd highly recommend looking into it, most of the papers are relatively easy to read, and rely largely on empirical results and intuition, rather than deep theoretical proofs or the like.