"An AI erroneously banned the channel," shouldn't get any more leeway than "A support staff member banned the channel."
Genuinely asking: what do you think profitable companies would do to their ML engineers over a product issue like this if there was no law under which they would be sued?
I think accountability without an enforcement mechanism is just a wishful suggestion.
Nothing. Maybe a reprimand at best, because the consequences of this are fairly minor. If a store erroneously bans you and them unbans you and says that there was a mixup with their policy, then what do you think should be the consequences to the store? If it's effectively a monopoly then I can see there being problems, but if it's just a random store then that doesn't really matter.
What would curtail the leeway then? Other than losing public trust in the product for this happening repeatedly anyway?
Personally, I think the AI is a total red herring.