A question for the authors. All the video is with vibrating but otherwise stationary objects. Must the object be stationary for these tools to work?
A question for the authors. All the video is with vibrating but otherwise stationary objects. Must the object be stationary for these tools to work?
There's a company that makes a rig that's basically just an engine and 4 wheels. You film your entire commercial using it and they replace it with computer imagery of your car in post. I can't find the video at the moment, though.
They use optical flow to get displacement values for each pixel. This works well when you don't have very large movements between frames, no sudden illumination changes and no rotations.
Car commercials will probably have all of those and on top of that be highly edited (e.g. you have to deal with cuts in the video)
You could try to use some other approach for motion estimation, like identifying and tracking salient points, but that would require quite a lot of work on top of what this demo shows.