Why does your security model treat your customers as the adversary?

They can already steer the tractor in any direction they want, for any nefarious purpose. You're just removing their ability to automate away labor (steering). This is essentially an economic, not a safety-oriented, policy.