None of these were binary decisions, but classifying one of around 10-20 conditions or rating cases on a 1-5 scale.

In all cases the models trained on a lot of this feedback were more consistent and accurate than individual expert annotators.