A truck or a car that has a 99% success rate would be the top threat to society and quickly rise to the leading cause of death under 30 if widely deployed.
99% successful web development where the 1% missing is security that and the company leaks its entire repository of user data every few months is not good.
99% successful car driving where 99% of 5-year periods have zero accidents per car is an order of magnitude safer than the average driver. (And gut feeling, I suspect approaching the tail-end of the safest drivers on the road.)
It feels like it's happening every Thursday and nobody cares. They just give people credit watch coupons or what's it called, and move on with their business. Worst case, a few pennies in fines.
But if CVS leaks your purchases on a weekly basis, it's probably going to affect people's willingness to shop there. (Or at least to use non-cash.)
Wait, aren't human-driven cars already the leading cause of death under 30?
I agree that LLMs have and will continue to increase the number of activities that people can DIY. But I believe many people will still choose to pay for others to do things on their behalf.
This is beside the point of the analogy though.
You have to look at the benefit of something when balancing against a cost.