Infinite universe can contain infinite set of objects without any of them being your doppleganger. Unless there's only limited set of objects that can exist in universe at all which doesn't seem likely.