I think with physical violence, it can escalate. You punch me and "win" the fight, next time I come back with a few friends and the fight may get worse over time. And that's just assuming it's only punches. If knives or guns are involved, it can escalate really fast, and perpetuate unresolved for years, if not generations.
And I agree with you that the violence is just taking other forms. One can't punch another, so instead, we shame that person, humiliate them, embarrass them in front of their friends and loved ones. I sometimes have fear of posting on public forums, saying something that will make someone angry, and then receiving an onslaught of comments ridiculing me and beyond.
So while I think some conflict can resolve itself through merely putting on gloves and duking it out, I think more often than not conflict resolves itself much better through communicating in a nonviolent way.