Humans are quite good at driving cars, as evidenced by the death toll per million km. In fair comparisons self-driving cars aren't even close.
Yes people would prefer to have agency in their lives and die based on their own decisions instead of a nameless programmer (a large fraction of the victims have themselves to blame for their death, this would change with self-driving cars).