> The results show evidence of systematic racial bias in all datasets, as classifiers trained on them tend to predict that tweets written in African-American English are abusive at substantially higher rates.
Wouldn't we need to know the true rate of abusive tweets by race in order to conclude this? Is this addressed at all, e.g. with human labelled data, or am I mistaken in thinking this is necessary?