Difference being that discrimination by race is already illegal and therefore banning white supremacy amounts to limiting speech. Banning white supremacy would be equivalent to banning support of caste discrimination, which is different from banning caste discrimination itself.