That is true. In the Saturn V case, the guidance computer checked the actual location of the spacecraft and issued corrections that had accumulated due to precisely that.
Atlas V burn was nominal, this error didn't happen until the capsule was out of the atmosphere.
And even more things can go very wrong with more complicated control systems.