What many people would want it just a complete block on select youtube channels and providers. Just whole hog, rip them out of any of the potential recommendations.
But that's not whats best for Youtube. The point system still stands in ratings, once exposed to the viewer, are gamified. They would however still work if it was a secret vote, but then, again, the user wouldn't be compelled to use it as people want immediate visual cues that they're doing what benefits themselves.