Re:Anime4K: Real time high quality video upscaling
by JonathanFly on Thursday August 15, 2019 @12:59AM
(#20702701)
I did some tests on this, trying to find footage I thought would be least well suited to interpolation:
Re:Anime4K: Real time high quality video upscaling
by AstralStorm on Thursday August 15, 2019 @06:10AM
(#20703939)
It will essentially look like flash animation of old, with moving unanimated components.
Even high grade interpolation sometimes has this problem - or the comparable "wake of water near moving object" one. Essentially you'd get tons of inpainting kind of artifacts.
But with 5fps, each frame can be so radically different, I think interpolation is generally just not possible. You can generate something smooth, but it will be so far away from whatever an animator would actually have inserted, that it will seem more strange/surreal than natural, and thus achieve the opposite effect as intended.
E.g. see [1] which shows animation at 15/30/60fps... you can see that even with the 15, it's hard to imagine an algorithm that would port well to 60. (Use the period on your keyboard to advance frame-by-frame.)
[1] https://www.youtube.com/watch?v=npMreLeVD6o