Are you going to care about some base rate when it's your loved one dying?
If self-driving vehicles overall increase safety, then I am not as upset as I am if they are known to overall decrease safety, because the fact of their presence being just or unjust is pertinent to the case.
Car infrastructure is notorious for focusing on the safety of drivers rather than pedestrians.
If self-driving cars increase safety for drivers and are worse for everybody else I am not sure it is a good trade-off.
In this regard we can adapt the saying about electric cars to self-driving cars: they are here to save the car industry not you.