1. You can only choose from pre-build characters (the poster-style thumbnails of the characters implies something different)
2. I don't think you can actually move the camera (or just wiggle it a bit)
They just carefully chained a bunch of things:
- segmentation to isolate character
- in-paint for character removal and a 360 HDR photo sphere for lighting
- pose estimation (and something equivalent for the face, but that was a bit weak I felt)
- estimate camera position from tracking points on the floor
- render hand built 3D model from poses and with light sphere
So the shortcomings for now are:
- you can only use pre-build humanoid 3D models
- you still need to film it with real actors
- face tracking doesn't seem that good yet
- lighting is semi-convincing
- no interaction with the environment (not even shadows)
- some visual artifacts from the character removal (I think mostly segmentation failing and hairs getting out of bounds, you can see it in the last shot)
I'm seeing it in my phone. Like I said, maybe I misunderstood, but the scenes didn't seem like real places (eg shot cropped so foot-shadows aren't included, as this is hard to get right in the composition).
You can see flaws if you look at the head around 1:56 to 1:58