Why would I want to get closer to people I consider evil? Why would I listen to people whose argument I have already found flaws in?
Until you can answer those questions, society will keep drifting. Dan Carlin had a good argument which essentially boiled down to we are all in this together, but the obvious counter example to that is to make the walls higher and eventually to make the other group submit.