Why is in order for us to do this, we have to do that? What about supporting Palestine bothers you so much?
Don't bring geopolitics into everything. That way lies madness.
A general ban on hosting conferences in geopolitically sensitive hotspots that covered Israel would be the non-hypocritical way to achieve this aim, supposing it is the true aim.
However, hosting a conference in Israel is inviting political posturing. Message censorship is political posturing. Using anti-semitism to censor non-anti-semitism is political posturing (and, usually, a form of anti-arab racism itself).