Yes, just think about a fleet of autonomous trucks carrying loads of valuable merchandise. A couple of these roadsigns that normal human cops would not detect, and you can redirect the entire fleet to your lair of doom.
Your line of thinking is really good. A well-crafted attack is hard to execute and little things can very well ruin an attack sequence. A subtle the difference between academic research and the real world.