No. Considering the other benefits of self-driving cars, such as increased mobility for the elderly, you can at most require that they are as safe as cars with drivers, not necessarily safer.
If the benefits were great enough (reduced pollution indirectly saving lives? saved life-years due to more efficient traffic?) one could even accept that they could be a little less safe as far as direct fatalities are concerned.