There are legitimate questions if physical constants are constant everywhere in the universe, and also whether they are constant over time. Just because we conceive something "should" be a certain way doesn't make it true. The zero and negative numbers were also weird yet valid. How is the structure of mathematics different from fundamental constants, which we also cannot prove are invariant.