Comment by TeMPOraL | Hacker News Reader

Comment by TeMPOraL | Hacker News Reader

Parent Full thread

> Unreal is now used a lot in specialized domains like film-making (globe fly-bys in the news and documentaries?)

It goes further than that now. For The Mandalorian, they famously set up a "20-foot high, 270-degree semicircular LED video wall"[0] to use as a backdrop for the shots, and that wall was rendering the desired environment using Unreal Engine. No need to chroma key an alien planet in post, when you can make it a part of the scene (and now the actors can see it too as they play!). More at [1].

--

[0] - https://www.polygon.com/tv/2020/2/20/21146152/the-mandaloria...

[1] - https://www.unrealengine.com/en-US/blog/forging-new-paths-fo...

From what I read about it previously I think they do actually re-render the backgrounds in post

But the LED video walls serve two purposes: ensure the lighting and reflections on real objects in the scene match up with the CGI, and give the actors a visualisation to work with.

> From what I read about it previously I think they do actually re-render the backgrounds in post

All the videos and reels I've seen on this talk about "capturing the effects in-camera", so while I wouldn't be surprised if there's some integration and cleanup work to be done (particularly where the wall meets the set), it does sound like what is on the LED wall is what we see in the final footage and it's not just placeholder or pre-viz.

I think you're right. They use terms like "final pixel" when they talk about it, which leads me to believe they're capturing the background and not just rerendering in post.

I think the biggest wins they get from it are that the actors can see what they're supposed to be standing in front of and that they get realistic lighting on the actors and other props from the environment

ILMVFX's YouTube channel has some fantastic BTS footage of how this works, for anyone curious:

https://www.youtube.com/channel/UCjnYk44Aj9E634TPucpIXnQ

Reply on news.ycombinator.com