Well, to be fair, a malicious person could just as easily shine a beam into the optical sensors on my face.

If someone really wants to cause an accident, it's kind of hard to stop them, regardless of whether you're in a self-driving car or not.