There needs to be a serious education effort to remove that mistaken idea from people's minds.
It's also a bit insulting to the audience to assume they are too dense to realize that the actions and opinions of one person are simply the actions and opinions of one person.
Even if those who are offended are overreacting, publicizing their views is probably the best way to be sure that both speakers and attendees can make well informed decisions about which conferences to attend.
Exactly.