In that case, "I'm downvoting you because you're wrong" could be condensed to "you're wrong."