Depending on how the universe works we only need to be the first in the galaxy (the chance for which is not that low). Also we can just be in the galactic backwater. there are places on earth we know nothing about. So the idea that we are in a part of the galaxy equivalent of the deep amazonian jungle is also not far fetched.

And the galaxy may be brimming with life - just so alien that we cannot recognize each other.