> A decent portion of the population against downvoting aren't against downvoting per se, it's downvoting without a comment or counterargument.

I would absolutely agree with this statement.