Re:Cesium for Unreal Now Available
by anentropic on Monday April 05, 2021 @09:28AM
(#26698627)
From what I read about it previously I think they do actually re-render the backgrounds in post
But the LED video walls serve two purposes: ensure the lighting and reflections on real objects in the scene match up with the CGI, and give the actors a visualisation to work with.
> From what I read about it previously I think they do actually re-render the backgrounds in post
All the videos and reels I've seen on this talk about "capturing the effects in-camera", so while I wouldn't be surprised if there's some integration and cleanup work to be done (particularly where the wall meets the set), it does sound like what is on the LED wall is what we see in the final footage and it's not just placeholder or pre-viz.
Re:Cesium for Unreal Now Available
by RobotCaleb on Monday April 05, 2021 @01:15PM
(#26701733)
I think the biggest wins they get from it are that the actors can see what they're supposed to be standing in front of and that they get realistic lighting on the actors and other props from the environment
I think you're right. They use terms like "final pixel" when they talk about it, which leads me to believe they're capturing the background and not just rerendering in post.
ILMVFX's YouTube channel has some fantastic BTS footage of how this works, for anyone curious:
It goes further than that now. For The Mandalorian, they famously set up a "20-foot high, 270-degree semicircular LED video wall"[0] to use as a backdrop for the shots, and that wall was rendering the desired environment using Unreal Engine. No need to chroma key an alien planet in post, when you can make it a part of the scene (and now the actors can see it too as they play!). More at [1].
--
[0] - https://www.polygon.com/tv/2020/2/20/21146152/the-mandaloria...
[1] - https://www.unrealengine.com/en-US/blog/forging-new-paths-fo...