The stats you give for human-driven deaths are for all conditions and all roads. Autopilot does not work in all conditions and all roads, so it’s not really a fair comparison.
Further to that, human deaths will be skewed towards drunk drivers and other “bad” drivers. Autopilot deaths will be “random”, so public perception will be worse even if the figures were exactly the same.
The other problem is complacency - the Apple software engineer had 2 seconds from his Tesla leaving the road to it hitting the gore point - and this was a bug he was aware of. If the car looks like it’s 100% infallible then peoples attention will naturally waver. How long does it take to react to a situation? Feel the weight of the steering again? Calculate the appropriate correction?
I think the system that replaces human drivers has to be 100 times better in terms of fatalities in order to be accepted by society.