I don't think I'm going to use a self driving car in self driving mode as long as I am expected to watch out for danger and take over if needed. If I need to constantly monitor, I might as well drive. Self-driving is only compelling if this means I can free some time for me while the car is driving, or at least make driving safer. Otherwise, it certainly just makes driving more boring and more dangerous.
Until then, I'm more a proponent of making driving easier by removing the manual gears so my focus can be better directed toward the road and less toward the gears. Engines do it better than me anyway.
I think it's pretty well known in the self-driving car industry that safety drivers do a great job if they have to intervene several times an hour. And they're good at getting the vehicle unstuck if there's e.g. a flat tyre. But for a system that only needs an intervention once a week? The safety drivers often won't react fast enough - they're just there to take the blame.