The concern is real but ultimately it does not matter. Fact of the matter is, arguments like this have been used to justify racism for a long time.
"They are Savage so they need our religion. They are savages so they need to put in the fields to work. They are savages so they don't need education. They are savages so their art should be displayed in our museum not theirs."