I'd definitely feel better in a self-driving car where I wouldn't feel any awkwardness about changing the music or just watching a loud video on my phone.
As I understand it, a lot of women in the areas where Waymo's currently deployed feel safer without having a driver as well.