Your TLD registry operator still technically remains fully in control of your records. I am actually surprised more of them have not abused their power so far.
If you want to see what happens otherwise, just look at the gTLD landscape. Still, genuine power abuse is relatively rare, because to a large extent they are selling trust. If you start randomly taking down domains, nobody will ever risk registering a domain with you again.
Having a healthy competitive market for DNS services is good enough.