Both convolutional and recurrent architectures were developed in late 80s. LSTM (improved RNN) was published in 1997.