Yes, it is elitist, but judging someone as being not up to the standards of a community is not the same as calling them subhuman.

As for the conclusion, the argument he's making is that he has seen evidence of a bias against making these harsh judgements, and it has led to the destruction of valuable internet communities.