Re:Self-Supervised Video Object Segmentation by Motion Grouping
by weidi_xie on Saturday April 17, 2021 @03:52PM
(#26846943)
The time for computing optical flow is indeed a bottleneck, and some researchers in the community is working on that:
- https://arxiv.org/abs/2103.04524
- https://arxiv.org/pdf/2103.17271.pdf
In terms of runtime, it should not matter. Generally speaking though, the overhead of optical flow is often overlooked. For video DL applications, optical flow calculation often takes more time than inference itself. For academic purposes, datasets are often already preprocessed and the optical flow runtime is not mentioned. Doing real time video analysis with optical flow is quite impractical though.