Safety is obviously important, but we already accept a decrease in safety over money and convenience (otherwise, we would have a 30kph speed limit everywhere).
But most people use their car for commuting, groceries, dropping the kids to sports, etc. They may make one or two road trips a year for vacations or business.
To facilitate this, a middle class family will often own two vehicles, pay tax, insurance and maintenance on said vehicles, pay for parking, etc.
If that suddenly wasn't necessary, that would be a massive saving for most people. You no longer need the capital investment in something that loses value.
Even better, you don't need to bring little Suzy to football, you can put her in a waymo instead (once she's old enough obviously).
And when you want to go drive to see grandma, you rent a car for the longer trip.
All of that depends on affordable self driving transport of course.