Hi @bitL, I'm the author of the article. Yes, I think deep learning is a promising solution that replaces the need for manual fine-tuning and is certainly driving momentum in optical flow research. Something you may want to look into is sequence-to-sequence (seq2seq) learning (https://google.github.io/seq2seq/).