From what I've seen, at least in the sports arena, most of the physical fights start off with verbal insults. That could also be because sports already has an element of Us vs Them built into it. However, the speed with which things escalate from verbal insults is quite amazing.