True, but self driving cars have to be much better drivers than the average human for multiple reasons.
If a human has bad driving habits you can fine him or revoke his driving license without impacting the rest of the drivers. A bug is a self driving software would require to stop all the self driving cars at the same time. Obviously, that would be a problem.
Bad drivers only drive one car at a time and thus they have limited potential impact. Again, a bug in the deployed driving software would impact many more cars, with consequences multiplied by the number of cars. This could have disastrous human consequences, thus more care must be taken.
Finally, human are legally responsible, if something bad happen they can compensate for the damage caused. This is unclear who would be responsible in case of self driving cars.