Whether imitation works as expected depends on your mental model of what the person/thing you are imitating is doing, otherwise you won't actually be copying.
If you wrongly assume that the person is deriving an absolute steering angle from the image then you will fail.
If you correctly assume that the person is deriving a relative/correction steering angle from the image then you will succeed.