This happens with neural nets as well. As they progress in their training, epoch by epoch, accuracy plateaus. There is always a tradeoff between keeping on learning and applying knowledge. Companies have the same dilemma between research and production - if you keep researching too much, you never get to produce anything, and vice-versa.