Random people manually driving their cars are "modifying" their input as well.
You have drunk drivers, texting drivers, distracted drivers....
The human attention span is incredibly brittle as well.
In terms of QA'ing a manual driver in the US? You take a 10 minute driving test when you're 16 and you're licensed to drive for the rest of your life.