How do we know anything in the past actually happened? We are 100% reliant on memory, but an equally plausible explanation is that we materialized 1 nanosecond ago, pre-loaded with memory and state. And in 1 nanosecond we will cease to exist, but at any point in time we will never know if that is true.
Science and repeatable experiments, models of the universe etc. refute my statement, except science is based on the assumption that my statement is false, so it is a circular argument.