The code actually says that you agree to be removed if you "wantonly behave in a manner inconsistent with" it, and only one of the paragraphs mentioned minorities: they chose to lead with a general requirement to treat others with respect, dignity and empathy, regardless of who they are.
This is not a code of conduct designed to punish accidental "thought crime" against minorities: it is designed to prevent intentionally or recklessly offensive behaviour towards any and all conference attendees.