Absent an explanation of why I've annoyed people, I get as much of a dopamine hit from downvotes as upvotes. I'd rather be polarising than forgettable.
Whenever I take an unpopular stance I remind myself of Rick Sanchez's wise words, "Your boos mean nothing, I've seen what makes you cheer".