Yeah? But that's an argument against seeing any aliens up close (if you believe in that kind of thing), because presumably they're extremely unlikely too.
They're not there, or they're far away in time and space, with a remaining tiny chance that something incredibly unlikely happened.