Why not? Exactly because there is nothing tethering our axioms on paper to what is necessarily true. You could formulate something wildly different from ZF±C/Peano/whatever normal axiom system, but we wouldn't call it "math", and what we currently call "math" will work under any conditions