Re:‘Artificial Intelligence’ Was the Fake News of 2016
by eva1984 on Monday January 02, 2017 @03:06PM
(#13303986)
Without development of technique like Dropout Batch normalization, residual connection, better optimizer like Adam, even with enough data and computational power, DL won't be nearly as powerful as it is today.
CNNs, RNNs, LSTMs, reinforcement learning, gradient descent, backpropagation - all that was used in the 90s, but given the limited computing power they had, people simply couldn't run large enough models on large enough data to get results.