News for hackers. Stuff that matters.
Re:FILM: Frame Interpolation for Large Motion by tehnub on Tuesday December 20, 2022 @12:36AM (#34061974)
Frame timing is an integral, creative aspect of the medium, not something to be fixed.

1. https://www.idtech.com/blog/what-does-animating-on-ones-twos...

2. https://www.awn.com/tooninstitute/lessonplan/timing.htm#:~:t....

3. Search for "A good example would be this cut, and especially the first four shots." in https://animetudes.com/2021/03/06/the-kanada-style-in-contex...

Re:FILM: Frame Interpolation for Large Motion by modeless on Tuesday December 20, 2022 @12:59AM (#34062122)
> Frame timing is an integral, creative aspect of the medium

> not something to be fixed.

The first does not imply the second in every case. There are many, many instances where a creator with unlimited resources would have chosen to drawn more frames. And now we can. We don't have to indiscriminately interpolate everything to 120 Hz, but I think it's clearly possible to make huge improvements to a whole lot of hand drawn animation.

Re:FILM: Frame Interpolation for Large Motion by tehnub on Tuesday December 20, 2022 @01:01AM (#34062139)
Sure, maybe a creator can utilize AI interpolation as a tool. I understood your comment to be about applying AI interpolation to works already completed.
Re:FILM: Frame Interpolation for Large Motion by modeless on Tuesday December 20, 2022 @01:03AM (#34062153)
Both.
Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Tuesday December 20, 2022 @03:05AM (#34062979)
As someone who already interpolates media with SVP4, I remain unconvinced by those arguments. My media looks amazing running at 120 hz, I don't get headaches by jarring panning shots that look closer to a slideshow than a movie.

I recently watched Avatar 2 in IMAX 3D with 48 FPS, and it looked incredible. If only all media in the future could let go of the arbitrary 24 frame limit, which was made a hundred years ago because filmmakers wanted to conserve their film usage.

Re:FILM: Frame Interpolation for Large Motion by dagmx on Tuesday December 20, 2022 @03:23AM (#34063111)
Avatar 2 was shot for 48 fps. It’s very different to interpolating animation to a higher frame rate.

Most animation is shot for 24 fps on twos, so 12ish frames (we usually go between 8fps and 24fps)

The difference is that we design poses to read at a given frame rate and have performance characteristics at those rates. If you were to interpolate it, you’d change a fundamental characteristic of the acting.

How long a ball makes contact with a surface is important and interpolation struggles to understand something that should stick to a surface for an extra frame versus something that should be blended.

Yes you’ll potentially get lower strobing but you’re also now getting a different performance. Maybe you don’t care, but it’s fundamentally changing things away from the intention.

This is a different discussion than just simply what frame rate video is shot at.

Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Tuesday December 20, 2022 @03:27AM (#34063139)
Yeah you're right, I don't actually care about the difference in performance, I can't tell it apart honestly speaking, I just notice the extra fluidity which I'll continue to use.
Re:FILM: Frame Interpolation for Large Motion by dagmx on Tuesday December 20, 2022 @03:32AM (#34063174)
That’s fair, and that’s always a viewers choice to make , especially with home viewings.

> I remain unconvinced by those arguments

Though hopefully that does go some of the way to convince you that the arguments are legitimate.

Re:FILM: Frame Interpolation for Large Motion by numpad0 on Wednesday December 21, 2022 @08:39AM (#34080557)
After giving it a day, I think I understood the problem. That extra fluidity isn't expected to be necessary by most animators, as well as audiences. This might be the realms of assistive technologies, like subtitles fundamentally is.
Re:FILM: Frame Interpolation for Large Motion by fomine3 on Tuesday December 20, 2022 @10:30AM (#34067230)
Also consider that real videos and CGs are "shot" by 24 fps, but 2D animations aren't shot but drawn by human. Animator decides what picture should be an inter frame.
Re:FILM: Frame Interpolation for Large Motion by numpad0 on Tuesday December 20, 2022 @04:39AM (#34063698)
It should be okay for video. Parent comment is about animation. The distinctions is whether the individual intra-frames are shot or drawn.
Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Tuesday December 20, 2022 @04:44AM (#34063739)
I've used it for anime and other types of animation (such as CGI based media like the show Arcane), both worked fine in my view, couldn't tell how the performance was impacted.
Re:FILM: Frame Interpolation for Large Motion by numpad0 on Tuesday December 20, 2022 @10:20AM (#34067067)
... at the end of the day, HN comment might not be the place to explain the theory and history of animation from late 18th to early 21st century, it just don't seem to make sense to do so to me. Maybe some of [0] or [1] explains why frame interpolation for animations is a bad idea(even for some of CGI animations), if they don't, I just don't have words for that right now.

0: http://gurneyjourney.blogspot.com/2014/07/elongated-in-betwe...

1: https://twitter.com/animepiic/status/1562932959472238592

Re:FILM: Frame Interpolation for Large Motion by tehnub on Tuesday December 20, 2022 @04:39AM (#34063703)
>slideshow

Are you talking about inconsistent frame timing aka judder? 24 divides evenly into 120, so you shouldn’t have that problem on a 120hz tv anyway.

Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Tuesday December 20, 2022 @04:43AM (#34063732)
No, I'm talking about when a panning shot comes up, the video feels as if it's a slideshow due to how few frames there are with how much motion is occurring. Compare it to a video game where running at 120 FPS and moving the camera around looks much clearer than doing the same thing at 30 FPS or fewer. Note that I'm not even talking about input lag (aka the game feeling better at higher FPS), I'm talking only about how it visually looks on screen. I much prefer the higher FPS.
Re:FILM: Frame Interpolation for Large Motion by kuschku on Tuesday December 20, 2022 @09:23AM (#34066276)
Even at native 24Hz, 24Hz motion looks so stuttery. Hell, even Avatar 2 at 48fps looked stuttery during action sequences.

If motion is too fast for a given framerate, my mind immediately stops interpeting it and I stop being able to focus. I absolutely hate 24fps content with pans, because the moment there's a pan, I just see a blurry mess and it takes several seconds to readjust after the pan is over. It's annoying, it's distracting, and I hate it.

Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Wednesday December 21, 2022 @02:02PM (#34084870)
> Hell, even Avatar 2 at 48fps looked stuttery during action sequences.

Likely due to variable frame rate, I noticed this too. If they kept it at 48 FPS throughout, it probably wouldn't have been so stuttery, but they decided to make it randomly 24 FPS within the same scene which was almost unwatchable.

Re:FILM: Frame Interpolation for Large Motion by kuschku on Thursday December 22, 2022 @03:00AM (#34090959)
But that's the interesting part: It shows that we only tolerate 24Hz because we're used to it, not because it's actually good!
Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Thursday December 22, 2022 @03:04PM (#34097905)
Exactly. That's why I want more HFR films and media.
Re:FILM: Frame Interpolation for Large Motion by atoav on Tuesday December 20, 2022 @05:11AM (#34063904)
I studied film and worked as a DOP. There are some aesthetic aspects to frame rates many people don't consider.

With lower frame rates (24/25) you can expose individual frames longer, which leads to more motion blur with movement relative to the camera. Motion blur can be an deliberate choice, or a necessity: with higher frame rate the exposure time per frame drops, which means you need more light per frame, which means you either need more budget to light things or you need to push the sensor/film more which typically degrades color and noise performance. Nowadays this is not a big issue, but it can still be relevant if you e.g. do night scenes with available light or similar. Of course having double the images also affects the budget in different ways when it comes to storage, post production, offloading times, battery consumption, how well you have to perform your practical effects and so on.

If budget is not an issue, high frame rates change how a film or a scene feels as well. Things feel more real. Shorter exposure times/smaller shutter angles are traditionally used to make things feel more stressful. So habing a higher frame rate can be a good thing, but it can also be a bad thing, and it all depends on the story you are telling. For example a war zone action shocker with shaky immersive hand camera might profit from the high frame rates as it feels more real (and thus more shocking), while a fantasy story like the hobbit might feel a bit too real and thus uncanny using the same thing.

Art is very often about creating an aesthetical distance to the reality. That is why most masterful paintings don't look like photographs, why black and white photographs can aestheticise their motif, why directors never show people going to the shitter in certain genres etc.

IMO high frame rates in film are heavily influenced by the narrative aesthetics pioneered by video games. Many modern films have a video-gamey feel to them as well, in the way they show motion, physics and the camera angles/motions that are chosen.

So frame rate in film is an aesthetical choice, and like everything choices can be made wrong, especially since films are made 4 times, once on paper, once on set, once in the editing room and once in the head of the viewer. Maybe what seemed like a good choice on day one on the set turns out to be a bad one on the last day. Maybe on set everything seemed like the right choice, but in the editing room the focus of the story shifts and you regret not shooting it differently.

I wonder when we will see variable frame rate films where film makers can use the frame rate as an aesthetical choice on a per scene basis..

Re:FILM: Frame Interpolation for Large Motion by adgjlsfhk1 on Tuesday December 20, 2022 @07:41AM (#34065048)
you can always add blur across frames if it fits better artistically
Re:FILM: Frame Interpolation for Large Motion by actionfromafar on Tuesday December 20, 2022 @09:02AM (#34065982)
Yes, increasing costs (artist- and technical) even more in post production.
Re:FILM: Frame Interpolation for Large Motion by Gordonjcp on Tuesday December 20, 2022 @09:56AM (#34066708)
That's surprisingly hard to do well, and is a very very very slow process.
Re:FILM: Frame Interpolation for Large Motion by atoav on Tuesday December 20, 2022 @01:28PM (#34070063)
Try doing that with a lot of parallax movement and DoF and it will look like a fest of weird blocky artifacts, because different depths of the image move at different speeds which means you would need to blur them into the dorection of the movement at different depths. Moving objects can become semi transparent at the edges which means generating that will involve knowing (or guessing) what is behind objects. This is non-trivial and very hard to solve in a general way.

The current best way to do this that I know of involves a ton of manual masking of elements at different z depths and the results will look still worse than if you had done it in camera from the start.

Nobody wants to have to do that to 40 minutes of a 90 minute movie unless there is a really good reason to do it.

Re:FILM: Frame Interpolation for Large Motion by tehnub on Tuesday December 20, 2022 @01:28PM (#34070057)
>I wonder when we will see variable frame rate films where film makers can use the frame rate as an aesthetical choice on a per scene basis..

There’s this. It looks like they used it in Avatar 2 actually. Not sure how widespread it is otherwise. https://www.pixelworks.com/en/truecut

Re:FILM: Frame Interpolation for Large Motion by satvikpendem on Tuesday December 20, 2022 @03:04PM (#34071692)
How it's done in Avatar 2 was pretty bad, in my experience. The transitions between framerates were just jarring, since they seem to have used it mid scene even. I'd have much rather just preferred 48 FPS throughout the movie.
Re:FILM: Frame Interpolation for Large Motion by bcraven on Tuesday December 20, 2022 @03:07AM (#34063001)
The animator Noodle recently put this video on YouTube that explains why he despises the idea of interpolated video:

https://youtu.be/_KRb_qV9P4g

Re:FILM: Frame Interpolation for Large Motion by rowanG077 on Tuesday December 20, 2022 @04:51AM (#34063783)
I agree that it is part of the creative process right now. But it is nothing but an artifact of it's time, where it would exorbitantly expensive to create 60 animation frames. Just like 30fps video and and black and white television and games back in the day.

60FPS animation as the default is superior to the choppyness we have nowadays. But the industry has to adjust their process, and upscale animation may never look right.

Re:FILM: Frame Interpolation for Large Motion by maeln on Tuesday December 20, 2022 @05:34AM (#34064057)
It is also true that a lot of time, the "low" framerate in Animation is also due to budget. But it is then seen has a artistic limitation and therefore is part of the final art.

I think having good interpolation technology *in the hands of the artists* is awesome: You can make buttery smooth animation for a much lower cost when you want. But you get to keep your full creative control over the timing and framing whenever you want it.