Except it's not. Abusive relationships begin based on trust, and then go bad as the abuser sets into their patterns. They're hard to break because they started off so (seemingly) well, and the victim starts second-guessing that maybe it was they who triggered this bad behavior (thus, they stay to try to fix it). It's also harder to break off something that you've invested so much into already.
That's not at all the same thing as someone who starts off with a violent or threatening act.