It’s the error with the ground truth that you can’t predict. Otherwise you would just be able to cancel it out. You can only predict probability distributions..
Ironically, reality probably isn't deterministic. It definitely isn't at small scales (e.g. radioactive decay). If it's non-deterministic at a macro scale, the effect is small enough that we don't see it.