Answering your objection from the pragmatist point of view: obviously their behavior somehow depends on they belief in human races, but it doesn't have to be a negative effect. I believe that my aunt would be extra nice to a black person, as she is very hospitable especially to people from far away and she would assume a black person in her country has to be some kind of immigrant.
A similar case is sex, believing there are two different sexes doesn't entail sexism. Per analogiam: believing there are different races doesn't entail racism.