I agree with all that (though I don't really necessarily associate any of that with computer vision, perhaps it's my physics bias).
Having good state estimation, kinematic, and dynamics models of real world objects is something that is very mature in controlled environments, but not very mature in other environments.