Well, this also works from the opposite perspective: we have evolved to combat earth virusses, but haven't evolved to combat anything from another planet. Lacking the shared evolutionary history may leave us more vulnerable.
(not that I find any such scenario to be even remotely likely)
Edit: well, that's basically what's being said in a parent comment