They will complain that the robots are driving so nicely and defensively? That seems unlikely.
No, there will be complaints about how slow they drive because, without a doubt, there will be legislation requiring these cars not exceed the maximum posted speed limit.