News for hackers. Stuff that matters.
Re:Anime4K: Real time high quality video upscaling by Animats on Wednesday August 14, 2019 @05:45PM (#20700294)
Nice. Can they interpolate frames, too, so that old 5fps anime can get an upgrade?
Re:Anime4K: Real time high quality video upscaling by crazygringo on Wednesday August 14, 2019 @06:27PM (#20700687)
Going from something like 30fps to 60fps, interpolation works decently well in many cases, because there's already so much information encoded in the 30fps. And some 15fps can work too.

But with 5fps, each frame can be so radically different, I think interpolation is generally just not possible. You can generate something smooth, but it will be so far away from whatever an animator would actually have inserted, that it will seem more strange/surreal than natural, and thus achieve the opposite effect as intended.

E.g. see [1] which shows animation at 15/30/60fps... you can see that even with the 15, it's hard to imagine an algorithm that would port well to 60. (Use the period on your keyboard to advance frame-by-frame.)

[1] https://www.youtube.com/watch?v=npMreLeVD6o

Re:Anime4K: Real time high quality video upscaling by JonathanFly on Thursday August 15, 2019 @12:59AM (#20702701)
I did some tests on this, trying to find footage I thought would be least well suited to interpolation:

https://twitter.com/jonathanfly/status/1156343739738152961

https://www.youtube.com/watch?v=FRHmGEEemoY

Re:Anime4K: Real time high quality video upscaling by AstralStorm on Thursday August 15, 2019 @06:10AM (#20703939)
It will essentially look like flash animation of old, with moving unanimated components.

Even high grade interpolation sometimes has this problem - or the comparable "wake of water near moving object" one. Essentially you'd get tons of inpainting kind of artifacts.

Re:Anime4K: Real time high quality video upscaling by willis936 on Wednesday August 14, 2019 @08:14PM (#20701337)
Subjectively, temporal interpolation looks rather bizarre. I’m all in favor of using advanced upscaling techniques to recover lost information, but temporal interpolation adds information in that the artist never intended. I think the best approach is to have the display refresh rate be an integer multiple of the source content frame rate and duplicate frames.
Re:Anime4K: Real time high quality video upscaling by janjanson on Wednesday August 14, 2019 @06:01PM (#20700463)
SVP is the most common solution for this kind of thing: https://www.svp-team.com/wiki/Main_Page

By the way, most animated sequences are about 8fps even now.

Re:Anime4K: Real time high quality video upscaling by k__ on Wednesday August 14, 2019 @05:53PM (#20700375)
I saw some 60fps tom and jerry videos that looked pretty decent, so there seems to be some way of doing this.
Re:Anime4K: Real time high quality video upscaling by avian on Thursday August 15, 2019 @02:32AM (#20703064)
If anyone else went searching for this:

https://imgur.com/RVVnTNR

Re:Anime4K: Real time high quality video upscaling by goldenkey on Thursday August 15, 2019 @12:02PM (#20706380)
Wow, that is surreal!! Do you know what algorithm is being used?
Re:Anime4K: Real time high quality video upscaling by avian on Thursday August 15, 2019 @02:40PM (#20708276)
I don't know. I've found a few discussions on Reddit and elsewhere, but everyone seems to credit this particular Imgur post with no context as the source:

https://www.reddit.com/r/oddlysatisfying/comments/bikp2u/tom...

https://www.reddit.com/r/interestingasfuck/comments/biixsf/t...

https://www.youtube.com/watch?v=labEXi5nOso

Re:Anime4K: Real time high quality video upscaling by LocalH on Saturday August 17, 2019 @12:01PM (#20724637)
That looks awful, tbh. Sure, the smoothness is there, but it's also full of distracting artifacts.
Re:Anime4K: Real time high quality video upscaling by pluma on Thursday August 15, 2019 @04:51AM (#20703633)
They're decent in terms of image quality, terrible in terms of animation.

Aside from the obvious problem of motion interpolation having problems with acceleration/deceleration, there's a lot of nuance in the original animation that gets lost when you try to interpolate from one sprite to the next.

Even if you can avoid obvious artifacts, no interpolation algorithm can create new information, it can only derive from what's already there and guess at what's missing.

EDIT: If you dig through twitter you'll find some tweets from animators explaining why the results are bad. As mere consumers we might be tempted to dismiss that criticism as snobbery but animating is a craft and the interpolated results are objectively worse than the original.

Re:Anime4K: Real time high quality video upscaling by k__ on Thursday August 15, 2019 @08:39AM (#20704614)
When I read your comment, I asked myself if vector conversion could be a solution.

Old cartoons lend themselves to be converted to vector images and these are better to animate automatically.

Re:Anime4K: Real time high quality video upscaling by dividuum on Wednesday August 14, 2019 @07:43PM (#20701172)