I just don't know enough about the subject to be able to 'divorce the subject from the mouth' confidently. Perhaps a bit unfair, but I'd rather dismiss what he says than risk being misled.

It's like the opposite of 'appeal to authority' :)