Having a black elf is a miscast, because most races in LOTR depict real groups of people or real cultures in Europe. Elves are tall and blonde and represent the Germanic and Scandinavian traditions that Tolkien loved. They are strongly linked to Alpine mountains and European forests. Their language is based in how Nordic languages sound.
An Asian actor could fit in the role as long as is tall and thin but a credible African elf is much more complex to construct. Can easily feel out of place and as miscasted as would be seeing a black actor in the role of a german nazi soldier.
Harry Potter has black actors, but all of them are from UK (very smart move JK) and share a common culture. Their interactions feel much more realistic and cohesive by that.