We assume that certain aspects of reality are real because they are testable and repeatable. We say gravity exists because every time we drop something, it falls down towards Earth, and if we apply other assumptions while looking out in the sky, we see other objects falling towards each other. The assumption is logical and testable.
It is impossible to test whether we just materialized, therefore it's safe to assume it did not happen unless repeatable testing indicates otherwise.