I didn't read the author's charge of antisemitism as strictly guilt by association. I think Richler's argument is that the fixation on shadowy global plots threatening "good old England" both fits into a pattern of 20th century antisemitism (Russia, Germany) and provides a kind of "dog whistle" appeal to the old (antisemitic, xenophobic) aristocracy.