Do regulators have an idea of what test a car needs to pass to be able to claim certain things? It there were levels of tests and passing each gave you better rating, that might give everyone an idea of there the system is. But most of the talks about this type of stuff seems to be gut feeling rating. Someone will say they think some car/software is good, other's will say it's no where close and the conversation ends there.
It is also possible that updates can make software worse than it was before right? Say a software does pass some test. But how do you know it's still as good or better after some update?
Is the problem we know for sure if has specific issues or it is more that we have no idea where it might fail while randomly driving? Are all this problems considered solvable in short term?