Well, Meta just settled with states to the tune of 17 billion dollars for harm caused by its algorithms.

Air Canada, a few years back, was found liable when its ai bot promised discounted fares to a customer.

Companies are getting hacked and held to ransom regularly so bad software is getting punished alright.

Maybe the guy writing the actual line of code (or the guy in whose name AI code is being pushed to git) isn’t getting punished but software is definitely being scrutinised for ill effects.